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' PREFACE 



Several sophisticated work evaluation units around the country 
take great pride In thje fact that now they can complete a work evalua- 
tion for the non-tra i nabN e nentolly retarded client in one or two days 
that used to take them six to. twelve weeks. They should be complemented! 
How vaj Id is the Information obtained for predicting emp loyabi I i ty? 
Welt, that's another question. 

Until recently work evaluation for trainable mentally retarded has ' 
always taken one o*^ two days, especially the test and work sampfe phase 
som'etines referred to as the 'vestibule evaluation.."' T^e evaLjator was 
hard pressed to find a test-Gr-samp.|.e~>i.n-^hJ s_pr he r re p etoire ^ rhal" a 
TMR was capable of taklnq. This Problem served only ^to reinforce the 

eva luator's Impres sion of the 'T'*^ steroo tvpe.!!: a_neg.Llj^-i±Ll-e~-'') rod uce P 

who needs something to keop him or ner busy. In fact one can recall 
not too many years ago,. that work ovaluatipn was considered unfeasible 
for mentally retarded with IO*s below '3'^. 

The movement to develop work ovalt.atlon tests and work samples 
appropriate for the trainable mentally retarded has received Impetus 
from several sources. First, those h^billtatlon facilities that wanted 
to meet state vocational rehabilitation expectations had to offer 'a 
recognizable work*eva I uat Ion service. Those that Incorporated a 
"vestibule phase" Into thoir work evaluation typical ly purchased a* 
wort; sample package because of the prestigious apparatus. The resultant 
probl-en was that the evaluator could find little positive to say about 
the TMR's aptitudes and abilities compared to the '"criteria" furnished 
In the package. Second, evaluators began to recognize differences In 
performance and behavior among the tralnables tnat conventional testing 
and work sampling tended to overlook due to high cutoff criteria. 

The report prepared by Allan Doctor that follows, reviews the 
current state of work evaluation for the trainable mentally retarded. 
The Impression one gets from reading the report, and rightly so, Is 
that many people are scrambling about developing new approaches and 
new techniques, few are taking the time to properly validate Instru- 
ments, to set-up cross-validation and replication studies. 

TO THE READER WHO IS SHOPPING AROUfID FOR EVALUATION TOOLS, be 
wary of fancy packaqes. Yes, you will have a ready-made evaluation 
unit, but how will It benefit your T^^R clients? That Is, does the 
manual have norms for T^R^S? Can a non-reader take the^ tests or 
samples? Are the samples related to job opportunities in your geo- 
graphical area. 



TO THE READER WHO HAS A GREAT NEED TO DEVELOP NEW TESTS AND 
SAMPLES, to reach for the "pie in the sky", to create another WAIS, 
chances are your idea has or is being tried. Just about anyone can 
make a pegboard. But, provide evidence that a particular test or 
sample "Works" for your clients.... you'll be heads above all the 
developers in terms of helping your clients. 

TO THE^EADER WHO IS LOOKING FOR ^EADY-MADE MORMS, renember what's 
normal for the goose may be deviant for the gander. The, Equal Employ- 
ment Opportunity Commission has stressed the importance of .test 
validation based on local norms. We might expect that an. "average 
performance on the TOWER Electronics series by NewYork standards to 
be grades higher In geographic areas where electronics industries are 
less competitive. 

■ TO .THE READER WHO FINDS A REPORT F|FTY PAGES OR LONGER TO BE 
.AVERSIVE, there is a Summary of the Report beginning on page 65. 



t'' The <tone of the Preface may strike you as flippant or demeaning 
in comparison to the Importance of the subject. That was not the 
Intent. On the contrary, I a-n deeply concerned atout the topic. I 
see the future of work evaluation for the trainable mentally retarded 
Ts~hopefur," but "also as comprex"ari"d confusing ©spec laj I y If we continue 
to work at cross-purposes. Let's take an Intensive look at what 
predictive tools are currently available and give them ample oppor- 
tunity to. prove their statistical usefulness or worthlessnoss Instead 
of preemptorlly valuing or condemming them before their time. 



William J. TImmerman, Ph.D. 
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INTRODUCTION 



The vocational rehabilitation facilities and sheltered worksliops 
of Ohio are dead-end streets for some clients with competitive 
potential. This Js due. In part, to the Inability of evaluation units 
to adequately predict the competitive potential of certain groups of 
clients. Historically It was not too many years ago that all mentally 
retarded were considered Incapable of competitive employmertt,- and In 
fact, dangerous. When that was proven false certain arbitrary IQ^ 
cutoff scores were proclaimed as cutoffs under which competitive 
placement was "unfeasible". The present "f I oor" accepted by many 
facilities and even some researchers Is an 10 of fifty. But clients 
with below 50 lO's are being competitively placed and are holding that 
emplovment> " . 

Prompted by this, Quadco Rehabilitation Center ln°Stryker, Ohio, 
applied to the Department of Mental Health and Mental Retardation of 
the State of Ohio for a grant to explore: "Special Applications of 
Work Evaluation Techniques for Prediction of Employabl I Itv of the 
Trainable Mentally Retarded." 

In thje position paper which accompanied the application, the 
author stated that based, on his review of available literature, 
"tj^ere are no truly validated methods of assessing aptitude for work, 
the kln.ds of Jobs the trainable mentally retarded should be placed on 
In a workshop setting, and more Important, potential for eventual Job 
placement outsl.de the sheltered workshop."' 

The paper 'notes that the majority of test^ 'now "lised have floors 
too high to differentiate within the TMR population and that reliance 
upon one-trial learning merel.y reinforces the Initial retardation 
diagnosis. 

the paper also states that some trainable mentally retarded are 
automatically placed Into an adult activities center based on staff 
Impression rather than objective data. 



'Ouadco Rehabilitation Center, "A Position Paper on Vocational 
Work Evaluation of the Trainable Mentally Retarded" (unpublished 
paper submitted t^ the Department of Mental Health and' Mental 
Retardation of the State of Ohio, 1972) p.IL 
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Although there does appear' to be a system of natural selection- 
whereby some individuals with significant potential for employment^ 
outside the activities center are ultimately Identified, expedient 
.predictive measurement would save a great, amount of tlm^, expense, 
and personal waste* 

This is not meant to imply a lack of research and available data 
dealing with work evaluation for the mentally retarded. Many signif- 
icant studies bave taken place especially within the last decade. 
Generally, however, these studies were based on populations which 
were largely or exclusively composed of those classed as either 
''borderline" or "educable'' retardates* Scpte researchers even go so • 
far as to assume that when the population considered Is characterized 
by an IQ range In the fifties or below, It Is useless to think of 
these people In terms of competitive employment*^ Rotman, for example, 
•In his study on the effect of motor skill practice upon the mentally 
retarded writes: ^'Patients who had an Intelligence quotient below 

_f_I.f-t-y-were-e Mmlnated-because',--accordlng -to-4-he-rnst-l-tut-l<)nal-author^ 

Itles, they would be considered unlikely potential candidates for 
emp loyment/*2 

Increasingly, studies are emphasizing the fact that the Moderate 
Retardate," although usually considered "Incapable of meaningful 
ac hleye pient In traditional academic subjects" Is "capable of profiting 
from programs of training In self-care, social, and simple Job or voca- ^ 
tlonal ski I Is. "3 a case In point Is the study of Delp^ Involving two 
hundred students of the Training School at Vlneland, New Jersey, 
wherein It was found that pf sixty-nine jobs or training areas In use 
at the school, fifty-four were being fiUed by clients with IQ's under 
sjxty. Delp^s viewpoint that TMR adults can realistically be consld- . 
ered for competitive employment, is being verified by local experience. 
Of the thirty-nine retarded placed. In competitive employment by the 
Qiiadco Rehabl I Itatlon, Center 'of Stryker; during the 1973 fiscal year, 
twelve had IQ's of fifty-five or below. 



'jack Tobias and Jack Corel Ick, "Work Characteristics' of 
Retarded Adults at Trainable Levels'', Mental Retardation , December ]^ 
1963, 339-340. 

' 2c. Rotman, "A Study of the Effect of Practice upon Motor Skills 
of- the Mentally Retarded*' (unpublished Doctor's dissertation', Boston 
University School of Education, 1963) p. 7 

^Rlch Heber, "A Manual on Terminology and Classification In 
Mental Retardation", Ntonoqraph Supplement to American Journal of 
Mental Retardation Second Edition 1961, p,96 

^Harold A. Delp, "Criteria for Vocational Training of the 
Mentally Retarded A Revised Concept of "the Necessary Mental LeVel", 
Training School Bulletin, August 1957, pp. 14-20 
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If s'ome TMR adults ^re capable of competitive employment, how are 
they Identified? Most standard tests-and test :battertes are not suit- 
able because of readjng or academic requirements. Many others, such 
as those which emphasize single trial testing place the TMR at a dis- 
advantage because of the Individual's associated slow learning rate J 

The following general objectives were therefore established for 
the .present research project: * . 

1. A thorough survey of what has been done and what Is 
currently being done [i\ vocational- evaluation of 
trainable mentally retarded adults, 

2. The development of sclentif Icah/ validated evaluation 
tools, tests and job samples,, from which accurate 
prediction of productivity and employabi I Ity potential 
can be made of on early. stage In the individual ^s 

rehabHii'atfon-programi; ™ — - 

3. Investigation of the factors most Important in eventual 
employment of the TMR. 

4. Development of a phase of ^a vocational evaluation 
program based on objective measurement of work 
adjustment behaviors. 

5. Selective application of new rr^ethods, knowledge and 
techniques of vocational evaluation of the TMR. as 
acquired through the research project". 

6. Development of a model vocational evaluation program 
for the TMR to be used for training purposes for 
personnel In other facilities. 

• The fol lowjng^ pages^ contain the .esults of the'survey called for 
i.n the first objective.* The survey findings Indicate that the body 
of useful literature and tools applicable to vocational evaluation of 
the TMR aduJt Is very smalK For those studies cited, the. results are 
frequently ambiguous and occasionally conflicting. The vast majority 
of the studies were concerned with secondary Issues or failed to lead 
to really sigrllf Icjant, practical conclusions. In alj, the research 
cries out strongly for further work specifically designed to assess 
the vocational potential of the trainable, mentally retarded adult. 



Uack Tbblas, ''Evaluation of Vocational Potential of Mentally 
Retarded Young Adults*', Training School '3ul letin , February I960, p. 122 



DEFINITION OF TERMS 

TRAINABLE ' MENTALiy RETAfRQED : In attempting to define this term _ 
for purposes of. this study, no hard and fast boundaries will be drawn. 
It will t/e operationally defined In terms of IQ basically because this. 
Is the descriptive criterion used In the studies to be examined^; the 
group being researched lies 3,0T to 4,00 standard deviation units 
beldw/the m of .the genera I popu latlon according to the AA^^ Manual 
on^rmlnoicgy-and^CIas^If Icatlon In Mental Retardation (2ftd ed.), 
^T96l J' According to,.the same source this would correspond to an IQ 
range of 51-36 on the Revised Stanford-BInet Tests of Intelligence 
and 54-40 on the Wechsler-Bel levue Irvtel I Igence Scale, Children and 
Adult forms. . 

. Kirk (1962)2 defined a Trainable Men/ally Retarded (speaking* ' 
spv^clf leal ly of children) as *'one who, because. of subnormal IntelV 
llgence. Is not capable of learning In classes for educable mentally 
retarded but who does have potentialities for learning .(1) self care, 
(2) adjustment to the home and neighborhood, and (3) economic useful- 
ness In the home, a sheltered workshop, or an Institution/' His 
definition uses an associated IQ range of 20-49 • 

Efforts have also been made to^ define various levels of adaptive 
behavior within the retarded population. The system devised by Sloan 
and Birch cuts across the boundaries of other definitions. Level M, 
described as "Moderate'' Is classed In the school age portion of 
development as "Educoble" and, as adults. Is defjned as follows! 
"Capable of self-ma-lntenance In unskilled or semj-skllled occupatJ^pns; 
needs supervision and guidance when under mild social or economic 
stress." Those who are classed as "Trainable" during their school 
years are labeled "Severe" (Level III) and' their adult social and 
vocational adequacy Is described as follows: "Can contribute partially 
to self-support under complete supervl-slonl can develop self-protection 
skills to a minimal useful Jevel In controlled environment/'^ 



^Rfchard C. Scheerenberger , "Mental Retardation: Definition, 
Classification, and Prevalence", Mental Retardation Abstracts , Vol.1, 
No. 4, (October-December 1964) pp. 432-441. 

2$. Kirk, Educating Exceptional Children , Boston: Houghton 
Miff I In Company, 1962. . 

^W. Sloan and J. Birch, '*A Rationale for Degrees of Retardation", 
American Journal of Mental Deficiency , 1955, 60: 258-259. 
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The t.-rr ""^rrj i ncii'. I » • ' V.niv ! ! y. R. lard'-d", -^S^uSchI i i:i '.iNudy s 

will >.r. roi;-/nly acciorrc! w-r^. a 1 u 1 i.s-r><;.-i i'^ of '^.--5^1. However/ test's, 
will bo ro;:orit-cJ upcr. If th*--;r r'^pi Uj" i c n rvpn frills v.'lthln this range 
or within ono atondord d-vinrico o'^ o/:tii;r rJd^. jt v/lll be oGsumed 
In these latter cjr.cs thot the toot -popj l.^i-Mon con+alns a suf f^ Id ent. 
proportion of T*."^'s for tnc results lo (general iy reflect their perform- 
"ance.. \^hero a ^r-.-^ll-^r c.uarutity of T'^'s 1^. :nvo I vc-d, It will tie assumed . 
that the to<^t '^o-jul+s .do nr-t v»i ^ni i icm'-^y reflect th/-ir participation. 

yCGATLONAL W^RK E V/^-LUATlCN : - V'ork Tv-i I option as defined by the 
U.S, Dcparjtn.^nt of hK-^Mh, Educotion ard^V/ol far^-l moar]r>; 'The appraisal 
of the indivlduarr, capacity ircl-uding j)ottorns of work behavior/ 
ability to ^couire occupational sMIls, and +he 5oloction of appropriate 
vocational noals/* This Mof inition includ<?s ''tho ut i I i^ation of^>/ork, 
sinulatod or real, to assoss the individUs^rs capaci.tios to Dp>4orm in 
a work cnv[.ronmept: work exDor I'^nces, v.-lt^iln the f-acility or in conjunc- 
tion with outs-ide industry, to as^^^st the individuefis to acquire 
knowledge, develop skills and/or "assess readiness for Job placement" 
and '*self appraisal'*. - 

The elements contained In the above defini + ion could' be Inter- 
preted to include the 'entire life spectrum of the evaluee. In fact, as 
noted by Spelser: "The determl nation of potential for achieving 
vocational adjustment Is an Integral port of a persoh's total life 
functioning. "5 Vocational Evalt/atlon must be able to calj upon a wide 
, range of data Involving such fields as psychology, sociology, and 
* medicine; In .one sense of the, word, therefore,, a project dealing with ^ 
^'ocatlonal work evaluation would need to include the instruments and 
procedures of al I these fields^ " * 

Because the majority of Work Evaluation personnel are not trained 
. to gather and interpret this broad spectrum of data, a more narrow 
definition becomes a necessity to provide practical boundrles for this 
paper. . ' ' 

For the purposes of this study work evaluation will be defined 
as follows: "The assessment of present .capacities, and potentials of 
handicapped adults as related "fo productive work. This assessment Is 
to Include the use of such too.ls as are readily available to a work 
evaluator to deterrilne present and future capabilities. Interests and 
adjustment to work and Its environment." 



lU.S. Department of Health, Education, and Welfare; Social and 

Rehabl.! Itatlon Service, RehabI I Nation Services Administration, 

Stand ards for Pehab' 1 1 tatlon Facllltl es and S helt ered Workshops > 

(Washington- D.C. , 1960),. ^ 
ft 

len Soelser, 'The f^rof esslona I In Vocational Evaluation**, 
in Readings In Work Eva I u'^-^ lof>_ l_, ^*d. Walter A. Prultt, (^^aterials 
[Jovelopment Center, Stout ^.tato UV.iversltv, MenonK)nie, Wisconsin, 
1970) p. 2 



Tests wfiTch' presuppose a rhaster^s degree I n ^psychology for proper 
administration wljl be omi ttectpf rocn' the scope this study except ^. 
where they form part of a test barttery.- , ^ . 

In essence, therefore, the Instruments dealt with In this- study^ 
will be te5ts of perception, dexterity, aptitude, interest, and voca- 
tional ability; samples of xeal and sirpulated work;* and methods used 
foKx>bs'erVatrjna! a^sessmagl^ot *OTk b^".evl6rs andy^tltudes, , . 

All {published tests mentioned In the. studies., Incjud^lag those * 
which woQIxt fj6t custofftarl lyb^ ^djpInJ-stered -In the wbr^lj.. evaluation 
unit, are.^j^rlbed in. the appendbx, Technical data and reviews were 
ut 1 1.-1 zed when' a Val I able. * ' ^ 
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' " PROCFDURE y 

The qoal of the Initial pb'ase of this stu.dy Is a comprehensive 
survey of^l I terature renardlnq nrftdlctlve measures of employa^I 1 1 ty 
for the-TMR. In an effort to discover and isolate these resources, 
ttfe first step was to consult sunnaries of research, bibliographies 
and conduct compqter*^ searches. The following are the major sources 
used In each case: * ^ 

% 

• V 

SUWr^RlES OF RESEARCH 
^ a ' 

• Cdbb'r Henry 0., The Forecast of Fu I f 1 1 Imento 1972, 
Teachers CoMene f'rcss, New York. .* 

* Gold,-^4arc^W.^ ''Research on the VocatlonaJ Habllltation of 
the Retarded, ^tho Present, The Future" in E\iIs, Norman R., 
i\ .i (ed.) International Review of Research In Mental 'Retarda tu-.i 
''^**^Vol. 6, 1973, Academic Press, New York.- 

Wlndfe, C\ D., "'Profinosis of 'tentaJ Subnormals**, Amerlc a_n 
Journal of Mental Deficie ncy, *^ononranh Supoiement, 1962, 66. 

Woi fensberqer. Wolf, '•Vocat'lona I Preparation and Occupation'',- 
•In Baumelster, Alfred A., (edl). Mental Retardation Appraisal , 
Ed ucation, and Rehab i 11 tatloji, 1967, Aldlne, Chlcaqo, p- 232ff., 

* Long, Huey B. , The Education of the Mentally Retr -ded .<jult: 

* ^ Selective Review of Recent Literature , 1973, Adulr Education' 
Association of the USA/Washlnoton , ^. C. , 

^BlByPGRAPHIES ' , • , 

^ ^d) Fry, Ronald R., Work- Evaluation 'An Annotated Biblloq- 
raphy ,. 1971 , Materials D.evolopncnt Center, I'nlvf^rsitv of Wlscon- 
•stn ~ Stout. Menononle, Wisconsin 54751 

Work evalu a tion An Annotated '^ib lioo- 
r aphy 1 947- 1 970 ,^ 1 ojj SjJ0j)J encn^^ 1Q7?, '^^tc^rinls ^ov^loo^ient 
\ Center, Unlversify of Wisconsin - Stout. Menononio Wisconsin 
•^VV'S475I. • 

*' * '''f - «.'ork Lvaluo t ior) anU Ad j ustnieni A n 

*V Ann otated fUU iogra n_hy 10 72: Supple nent, 1^73, 'Materials 

'* .^pevelopf^ent Centor, Unlversitv of Wisconsin - Stout^. ^onononle, 
•* Wisconsin 54751 ' 



J 



Cotrb, Henry V., The Prodlctl.ve Atrsessmont of the Adult 
Retarded for Soclal and Vocatronal Adjtistment; A Review of 
Research^ Part I, ANNOTATED BinLIO^RAPHY, l9f)C), South Dakota 
University, Vena I'll ion. 



COTPUTER SFAHCHES : ^ v • . 

^-The following computer searches were run with 'the Indicated 
Descriptors: ' / 

OATRIX . • . . " A * 

Xerox Un I vers I ty f-' I crof 1 1 ms " \ 

. P.O. Box 1346 ' \ 
Ann Arbor, Michi^jan 48106 . \^ 

^ROBE ' ' . 

Educational Resources Info.rmatloh Center (ERIC)^- 
* School of Education, Indiana University ' . 

^ B l oom I ngton , Ind'ana * 

PASAR*" ' ^ ' 

' American Psychological*' Association ' ^ -^^^^ 

"1200 17th Sr., N.W. • . , 

^- Washlngton/O.C. • . . 

Descriptors used:' Work, Sample, jest, BehavJor, Adjustment, Evaluation, 
Prediction,. Emp I oymfjnt, ^Predictive Measurement, Job, Prediction of Job 
Adjustment, Prediction of Employment Success, IPred IctJon of Job Success, 
MentaJ Retardation, Trainable .Mental ly, Handicapped, Mentally Hand I- 
.cappeo. Vocational Rehabilitation, Vocat I onai -Training, Rehabilitation, 
Vocational Adjustment, Prediction, Predictive Measurerrient, Predictive 
Validity. ^ . • ^ . * ■ 

A manual search ctlong the same. lines was concjugted by: 

_ J^Aj|Ri.AtS DEVEtOPMENT CENTER ' 
» ^ University^ of Wisconsin ^ Stout 
Menomonle, Wisconsin 5475J 

. : . ' ' ' . ^ ' ' ■ ^' . 

The .bibl lography of each research article was' examined forjurther 
potential sources and al L articles ^and publications were listed and 
.cross-Indexed* Three hundred £jnd thirty-seven works were catalogued* 
By 'cher^^ng all of these against the annotated^blbl loqrafthles for clor- 
Iflca. '^o of their content, the list of potentially relevant stud I es was 
redqced to seventy. 

FInajly, approximately twenty studies were found which appeared to 
contain sufficient- fac+uaUand statistical dat^ to warrant In-depth 
analysis^ These studies dealt primarily or exclusively with- a TMR 
population, .WerB presented. In suf f Iclent detal I to warrant analytical 
study (there are some exceptions to this requirement which are Included 



merely for Information because they represent unique types of studies) 
and contain Information which will contribute to predictive work 
evaluation for this population.. Y ■ 

Thare are, of course, omissions. 'Some studies are no longer 
available, especially. In.tJieJr^orlglnaJ form_.,._Reylsed__foms and 
^published editions often do not-contain the .complete research under- 
lying a project. Older articles In'publ Icatlons are frequently 
unavailable either from the publisher or libraries stocklr.j the more 
recent Issues. Sonw research projects have never j)een published and 
have simply disappeared. 

Some Inquiries for Information and literature went unanswered, 
but response from all over the country was generally good and somewhat 
better than was expected. 
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THE USE OF STANDARD TESTS 



'When this study bogan, it was assumed that there would be a 
significant amount of resuarch concern inq the performance of T^IR 
adults on standard tests easily accessible to the Wqirk Evaluatpr. 
A brief review of the arguments per+alninn to the use Sf -this type 
of test with a retarded population miqht bo In order* 

Tobias states: *'By definition, retardation assumes a slow rate 
of learning. StaruJard tests that measure' one-trial learning will 
reinforce the Initial diagnosis of retardation without supplying the 
Information more necessary for the determination of vocational- 
feaslbl I Ity.^l 

• Gellman^ ^--i^gests that the very "strength** of standardized tests 
may be their weakness. They are designed and administered to maximize 
the subject's performance. They are kept short to eliminate fatigue 
or, dec lining motivation. As a result, they poorly reflect the client's 
general orientation toward work or what would be expected from him In 
an actual job performance. 

Also, despite the fact that the conventional tests we are 
discussing hero are very specific In nature, the results are often 
generalized and the scores Int-erpretcd to reflect general ^'workln^'* 
abl I Ity. 

Frequently non-work attitudes and behaviors can be sublimated for 
the length of tlmo necessary to take a short, strjndord test and the 
Isolated settlno necessary for the aorrlnlstr^tlon of ^uch a test sheds 
no light on the client's norfornance under normal working conditions. 

Jack Tobias and Jack Corel Ick^ in I960 made an effort to 
dr term! no the predictive ability of a single standard test, tha Purdue 
Pegboard, for foretelUnq sheltered workshop performance of a retarded 
pODulatlon. 
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'Jack TobJan, "Fvrl'j^tion of *'ocatlopT| ^ofentl^l of *^entally 
Rcitarded Youn^ Adu)+s". 0£,_C2t. r?.l2?. 

2wiHfam nolHin, "The ^rlnc^olos of Vocational Evaluation", 
Peh?tb I n tjt i on L I t^^rat 'jr/^-. Aorl! n^^^, :^r). OP^in-?^ ^ 

-^J-ack Tobicis T\rtii Jack Oorelic'-^, Th^* Ef f fict Iveness of 1ho Purdue 
Pe^bo^rd in Evaluat^in^^ Work Potential of 'Retar-J^.d ^dnLts*', The Tr aining 
School n>i|l«tfn. Noy/l^^O. or^. /^-lO^. 
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SpociMc qj-js-ions raio^rJ -n the sturly were: 

(1.) y.Off do rot.^rdcd adults cor^por^.^ with nornal's in a meas-ro 
of dexterity that is presumably uncorrelated with intel Hgence? 

(2.) Can the Purdue ^egboard discriminate between different levels 
of dexterity below t'nose of^he standardization population of normals? 

(3.) Is thore a relationship between dexterity and intelligence 
within the retarded range? ^ ' " , t 

(4.) Are the dexterity scores more closely related to some nea- . 
sures of 10 than to others? 

(5".) How valid a preuictor of the vocatlonaj success of a retarded 
population Is the Purdue Pegboard? 

(6.) How does the Purdue Pegboard compare to more .commonly used 
measures In predicting vocational efficiency? 

The test population was composed of clients of the AHRC Sheltered 
Workshop and Training Center In New York City. Eighty-one clients 
composed the t-^st sanole although It Is not noted what. If any, 
criteria were used in selectinq the sample. The sample population ^ 
Included all 10 ranges of retardation above 30, (Significant IQ break- 
downs and groupings will be noted as appropriate). For this reason 
some of the results are not applicable to the JUR population. Most 
significant for our purposes is a partial replication of the Initial 
study. Included in the same cited article, In, which a test sample of . 
ninety was divided according to IQ rancje (full scale WAIS) with some 
lower scores obtained by the Stanf ord-Binet . In the latter study the 
responses of the Tf-IR group are specifically noted. 

' .Performance on the Pyrdue Pegboard was correlated with quantity 
of production on two separate bench operations. One was a ball-point 
pen assembly involving six parts, varying In size from a small spring 
to a five inch barrel. The other, the "Wl re-Clamp" assembly, required 
assembly of four metal parts to form a clamp. A U-bolt, threaded at 
both ends, supported a metal saddle held in place by two Identical 
nuts which were tig>itened by hand. 

The Purdue Pegboard was administered according to standard 
procedures. Duplication of directions or demonstration was given as 
necessary. Clients were trained In the two workshop assignments until 
they had mastered the entire operation. Average production figures 
were based: on fifteen hours for the .ba 1 1 -point pen and four hours for 
the wire-clamp assembly. The time sequence between admin 1 ^ration pf 
the Purdue and the two assembly operations was not noted. 

Significant differences were tound In performance on the Purdue, 
not only between retarded and "normaT* adults but also between different 
levels within the retarded rgpge. 



12 



DIFFERENCES IN PURDUE SCORES AT Tri'":E LEVELS OF RETARDATION - • 
ALSO COMPARISON WITH NORMAL POPULATION MEANS. 



IQ Level 


Mean 


Standard 


Mean 


Standard 




R+L+B 


Deviation 


Assembly 


Dev.Iatlpn 


30-49 


86.4 


13.3 


41.2 


8.8 


50-64 


107.2 


17.9 


57.4 


16.1 


65-80 


121.7 


14.5 


' 78.0 


14.9 


I ni^istr^a'I 










AppI I cants 


135.0 


(1) 


104.0 


(1) 



(1) standard deviation figures for three trials are 
not aval I able. 



oV the retarded samples Investigated, no one In the IQ 30-49 group 
reached the mean of Industrial applicants on either R+L+B or Assembly* 
(Eight percent of the IQ 50-64 group achieved tho Industrial mean on 
R+L+B but none on Assembly). 

Based on the Initial study l\Q range 35-78, Mean ,63) the authors _ 
suggest a substantial relationship between Intel I ectuaT functioning 
Cas measured by the WAIS) and manipulative dexterity. The authors 
further consider the factors subsumed by Wechsler In the VerbaT Section 
of the WAIS significantly less valid as predictors of dexterity than 
those Included In the Performance Section of the WAIS. 

correlations' between dexterity and intelligence 



^ R+L+B Assembly 
WAIS FuM Scale IQ .563 .666 
WAIS Performance .567 .730 

WAIS Verbal .340 . .427 



AM coefficients are significant at better than a- .01 level of 
confidence. 

According to the study, correlation between the Purdue and the two 
workshop tasks Is higher than between full scale 10 and Workshop tasks. 

CORRELATION BETWEEN PURDUE PEGBOARD, FULL SCALE \Q 
AND SELECTED WORKSHOP TASKS. 

Workshop task ^ Purdue R+L+B Purdue Assembly Full -Scale WAIS 

Ba 1 1 -Point Pen Assembly .788 , .678 ? 

Wlr^-CIamp Assembly .748 * .44 ' 

No relationships are listed between the workshop tasks and the 
performance section of the WAIS. 
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This study has more applicability to general populations, of 
retarded than to TMR groups. Figures citing reUtlonshlps between the 
Purdue and work (th* +wo workshop tasks) are discussedonly In terms 
of the total. Wheth r-t^e correlation holds true for the TMR subgroup 
Is uncertain. * 

Tho workshop tasks are both assembly operations which could.be 
expected to correlate with the Purdue Pegboard. It Is somewhat 
questionable, therefore, whether the results could be generalized to 
other types of tasks such as those found In service areas or even ... 
those requiri ng different types of movements* y 

X There Is no attempt to relate the study to anything other than 

. ' ' quantity produced which Is only a partial criterion of production,^ 
The authors do not comment regarding production quality* ^herfore, 
forv.example, we are not told whether or .not Incorrectly assembled 
' M^lts counted as finished pieces. 

The test sample would appear atypical since It Is noted that It 
was composed of adults "referred to the Workshop because of their 
Inability to make a .vocational adjustment In the community." Therefore, 
il^ls- questlCnable whether the resu I tS"woul:d" apply to the entire TMR 



population. 

Interrelation between R+L+B and Assembly was significantly higher 
(.82) among the retarded than among two norm^r popiulatlons (college 
students .58 and veterans .53). The authors had assumed that the 
correlation In the MR sample would be less "since. the Assembly sub-, 
test requires more than -merely manipulative skills reflecting greater ^ 
decrease of speed with greater^complexlt'y of task." They suggest that ^ 
the results Indicate IQ n«y have'signlf leant bearing also on simpler * 
subtests. It could also mean that other, undiscovered variables were 
at work. The proportion of Increase from first to third trial for the 
wide range MR sample Is approximately the same aS' f or college students 
between trials one and three. 

The R+L+B gain for the retarded between the 1wo trials was 6.4^, 
for the col lege students It Cas 8:i<. On the assembly subtest the 
gain for retarded was 12. 8^, for college students 12. 6^* The authors 
note that there Is less than one chance In a thousand that the dif- 
ferences between the means for the first and third trials of the' 
retarded sample ("t"=»7.7) woul d have been arrived at by chance. They 
do not note which subtest they are referring to nor do they present 
sufficient data to compute any of the mean differences for significance. 

Although there might be significant results fror/t the study related 
to general populations of retarded, they are of .limited benefit for TMR 
evaluation. The results suggest that there are apparent levels of 
dexterity corresponding to levels of retardation. Whether or not the 
' ioss of dexterity Is due to the level of retardation as the ai/thors 
indicate remains to be seen. Other factors such as lack of vbcatlonaT 
exposure should be considered before makinq the sweeping conclusion of 

( 
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a relationship between dexterity and Intelligence within the retarded, 
range. Insufficient Information Is available regarding relationships 
between performance on the test and total sheltered workshop performance* 

Several studies have been- conducted pertaining to the functioning 
of the Trainable Mentally Retarded on assortments or batter!es of 
standard tests and the possible predictive Implications of thiase results. 
In this area researchers generally attempt to predict client performance 
only from one ^tage of the evaluation program to the next, rather than 
attempting prediction of ultimate employabi I Ity from an Initial battery 
of scores. 

Cobb^ considered 'the pioneer study In this area to be the four 
.year project carried on by Parnlcky and Kahn2, at the E.R. Johnstone 
Training and Research Center In Bordentown, New Jersey (referred to 
as the "Johnstone" project). The relatively high \Q mean (mean 64, 
range 30-126) excludes the Johnstone study from detailed cover^age In 
our present survey but a general review of the methods used will provide 
an example of attempted prediction from a test battery. 

The vocational training program of the Center consVstedrGf five 

-phases:— Phase "I : prevocat4ona4-evaluatlon^(fl-weeksl;-^PhaseJ_lj Half- 

time vocational training, on campus (one semester); Phase III: Full- 
time vocational training with normal work day, on campus (two or three 
semesters); Phase IV: Daywork In the community, retaining residence at 
the Center (until competence Is demonstrated); Phase V: On Jobs and 
In-resldence In the community with follow-up service by State Division 
of Mental Retardation." - 

Three types of evaluation were undertaken with results compared to 
Relative performance throughout the phases of the program. Theser^were 
vocational appraisal, using work samples and;»real work situations; 
psych^Dloglcal appraisal ,\ comprised pi a tattery e.f motor, personality- 
temperament, and Intel ledtual tests; and vocational Interest and 
sophistication assessmenl\ using a preliminary form of a reading-free 
device for measurement ofVhe vocational -Interests of educable, 
mentally retarded adolesceirte.5 



'Cobb, Henry V., The Forecast of Fulfillment, (teachers College 
Press, New York 1972) p. 68 

2papn|cky and Kahn, Evaluating and Developing Vocational Potential 
of Institutionalized Retarded Adolescents; (unpublished research study 
by Edward R. Johnstone Training and Research Center, Bordentown, New 

Jersey, 1963).^ • ^ . 

• * 

'This was a preliminary form of^the VISA (Vocat'ipnal Interest and 
Sophistication Assessment). See review of same. 
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Results' In general Indicated that the prevocatlonal battery became 
Increasingly less predictive through succeeding Stages of the program 
and were virtually zero for final community employment. 

Cobb In his critical review of the project (Cobb p.71f ) .made^ " 
several significant observations. He felt the "eTitl re-pro-Ject-sirffered 
from "halo" effects caused by the fact that repeated field ratings of 
a given client were always' given by the same supervisor. He also 
suspected, that the ratings were Influenced by the motor performance of 
the clients (I.e., that supervisors' had a tendency to allow their 
ratings to be based mostly on the motor efficiency of the Individual 
clients). If-this were the case, niore objective* ratings would have a 
tendency to reduce the relationship between field ratings and motor 
tests- (the latter being the most highly predictive of the p.sychologlcal 
tests). 

There was an absence of significant predictability between any of 
the prevocaf lonal measures and the, rati ngs- by community employers. 
This could merely be reflective of the low reliability and/or validity 
of rating. scales In. general. 

The Johnstone project, possibly the most thorough of i>s kind, 
"indicates the difficulty Involved In vocational prediction, even from 
state to stage of a program. . \ ' 

In 1967, Lome Elkin carried out a study with a Tf^ population In 
which he* attempted, to develop a battery of tests which would be pre- 
dictive of performance on sheltered workshop tasks J His next apparent 
goal was then to try out. hfs best predictors In a non-sheltered emp loy- ^ 
ment setting. Unfortunately, when he continued the studyon through to 
this conclusion (El kin .1968) he used a second population- which was 
composed of EMR rather than TMR .subjects.^ It Is uncertain whether he^ 
assumes that whatMs valid for one population will be equally valid for^ 
the Other or whether he considers the TMR population ^as generally ' j 
unsuitable for competitive employment.^ 

Th^ .stated 'goals of his. 1967 project were as follow: (1) Objec- 
tifying criteria for measuring success on the job. ' (2) Predicting work 
potential of Institutional TM^'s. (3) Estimating predictive value of 
work samples. . . "* ' 

' / The populatJon chosen for his study consisted 6f fifty-eight 
residents of the Saskatchewan Training School at Moose Jaw. They ranged 
• In age from 15 to 52 and had an' IQ range from 20-55 (mean 34.4). 



^ korne ElkIn, 'Tredlctlng Productivity of Trainable Retardates on 
Experimental Workshop Tasks^\' Amepfcan Journal of M ental Deficiency, 
January 1967, pp. 5767580. 

^Lorne Elkfn, ^'Predicting Performance of the Mentally Retarded on 
Sheltered Workshop and Non- Institutional Jobs"', American Journal of 
Mental Deficiency , Vol. 72, pp.* 533-539. 
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Although one client was excluded because of color blindness, no 
Indication Is alven whether or not other criteria of exclusion were 
used to determlhe the final population. On the surface It wouW 
appear questionable that within such a wide IQ' range, no one was 
c excluded because they could not comprehend or successfully learn the 
tasks I required. Caution of. course should be exercised In qe'ftera I I zl ng . 
the results from sucha small homogeneous group, especially one In a 
highly structured Institutional setting. 

Procedure: Clients were trained on four experimental tasks of 
varying complexity: (V) Sort by color, (2) Sort by geometric form, 
(3) Assembly: Bolt, two nuts, two washers; (4) Combined operation: 
Measure and cut twQ wl res, assemble using screwdriver. Clients were 
trained and pretested on a sample, then administered each of the 
experimental jobs for six consecutive days. The work periods were held 
to a maximum of forty-five minutes due to limited Quantities of material. 
Unfortunately this length of time may have caused I nva I Id resu 1 ts . It 
would seern that lonqer periods might be necessary In order to ajlow 
factors such as fatigue, limited attention span, and boredom tO" take 
effect. Figures pertaining to the performance of Indlv-ldual clients 
for longer periods of time might have shed Mght on this problem. 

The four tasks were used as the criteria. The- predictors were ^' 
a battery of eighteen* tests and factors: Stanford PInet, Form L-M;' 

^ Raven Colored Progressive Matrices; Peabody Picture Vocabulary Test; 

^ Koh Blocks; Porteus Maze Test; O'Ccnnor F I noer- Dexter ify. Tect; Craw-, 
ford Small Parts Dexterity Test; Bennett Hand-Toot Dexterity Test; 
Purdue Pegboard; Dynamometer; Aqe; Aqe at Admission; Length of 
institutionalization; Hehavior Rati^nq Scale - Adjustment to .Work; 
Color Sortinq; Form Sorting, Hand Assenbly; Tool Assembly. 

The results were Apparently .determined by comoarlnq tota'I work 
score' with each of the prodlctor variables Includinq thn individual 
work samples. Significant correlations found are listed below: 

\ ■ ^ CORRELATIONS BETWEEN TOTAL WORK -SCORES 

■ . ^ ^AND NIMETEEM PREDICTOR VARIABLES . • . 

ViNable 



1. Revised Stanford Binet, Form L-'-^ 

2V Raven Proqres^sjve Matrices (1956) 

3. Peabody PictureN(pcabulary Test (B) 

4. Kchs Blocks \, 

5. Porteus' Maze Test 

6. 0*Connor Finger Dexterh^y Test 

7. Crawford Small Parts (Pin^\^ Col lars) 

8. Crawford Small. Parts (ScrewsK 

9. Bennett Hand Tool Dexterity \ 
10. Purdue Pegboard (Total Scores) 



Tota 1 


Work 


Fena 1 e 


Mnle 


.f54(1) 


.46(1) 


.58( 1). « 


.56(1) 


■ .?9 


.35 


.41(2) 


- .55(1) 


.47(1) 


.61(1) 


-.68(1)' 


-.56(1) 


-.5^(1) 


-.48(1) 


-.62(1) 


-.58(1) 


-.73(1) 


-.65(1) 


.80(1) 


.64(1) 
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CORRELATIONS BETWEEN TOTAL WORK SCORES 
AND NINETEEN PRtOICTOR VARIABLES 
(Continued) 



Variable 



• Total 


Work 


Fema I e 


Male 


.5.9(1) 


.36(2) 


.69(1) 


.61(1) 


.80(1) 


.6'^(1) 


.79(1) 


.70('1) 


.56(1) 


.52(1) 


.13 


.40(2) 


-.26 


.15 


.28 


.43(2) 


.66(1) 


.55(1) 



JK, Dynamometer (Strength) 

12. Work Sample I (Color Sort) 

13--^ Work Sample II (Form Sort) 

14 • Work Sample III (Hand Assembly) 

15. Work Sample IV (Tool Assembly) 

16. Age . ^ . 

17. Age at Admission 

18. Length of Institutionalization' 
19^, Rating Scale (Adjustment to Work) 



(1) Significant at .01 level of confidence * 

(2) Significant at .05 level of confidence 

Significant correlation Is found between the work sampies'and the 
majority of tests! EI kins states this corrfilatlon Indicates a "general 
ability" factor encompassing intellectual and psychomotor ski f Is Is 
related to job success (he refers to: Abel 1925; T Izard A O'Connor ^ 
1950^; Wagner Hawver 1965). But where has Elkin actually related -the 
J^•test battery to "Job success"? He concludes that the relationship 
between experlmenta I- Jobs and Institutional?, sheltered workshop, and ^ 
non-'Instltutlonal Jobs has yet to bo established. He does state that 
partial support for the validity of the experimental Jobs, Jience the« 
criterion, comes from the sIqnIflQ9Qt positive correlations fOund be- 
tween ratings of adjustment to work on cottage duties and performance 
on the -experimental tasks. Thd^ posslbi I ity must bo-ralsed, however, 
that' the same .contan I nation^ due to rater bias (supervisor ratings 
prejudiced by dexterity scores) could exist here as was suspected In 
the Parnlcky and Kahn study discussed earlier. This, coupled with the 
un/aallstlc length of work periods (ellnlnatlng accurate Sc^impll.ngs of 
work J)ehaviors, motivation, etc.), and the fallur^ of Elkln In the 1967 
study to actual ly fol low through and substar^ate his findings In 
either sheltered or competitive employment makes this Study of rela- 
tively 1 ittle use. ' ^ • 
^ ^ , .. . 
A somewhat simH3r study gslno some of the Scjme standard Instru-. 
ments was conducted In Akron,' Ohio 'by cdwin r. v/aqner and Dennis A. 
Harwver . ^ . * 



^Edwin* E. v;aqner and Dennis A. Hav5ver, •'Correlations Between 
Psychological Te^ts and Sheltered Workshop Performance for Severely 
Retarded Adults"; American Journal of Mental Deficiency , March 1965,. 
pp. 685-691. ~~ 
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^ Wagner and Hawver classify their paper as an attempt to develop one 
or more test predictors of sheltered workshop success In a sample of 
severely retarded adults. To be considered as part of the test popula- 
tjpn the client had to have a tested 10 of less than fifty. The 
Stanford-BInet, for L, M, or L-M was used. The test population of 
twenty-seven' had an average age of 23,7 (R=21/34, SD=3J) and an average 
jO of 34.4 (R=1V49, SD=8.8). The study took place at the sheltered 
•workshop operated by the Summit County Council for the Retarded Qhlld. 
Note here that about 34t of the t®st population (assuming a normal, 
curve) lies be.Iow the TMR range. , ^ 

The test Instruments used were the O'Connor Finger aod Tweezer 
Dexterity Tests, Placing and turning Subtests of the Minnesota Rate of 
Man I pu I at I on Test, The/ctlve Score of the Hand Test, Goo^enough- 
Harrls Draw-A-Man Test'' Bender VIsual-Ntator Gestalt Tes;f and the 
StanfordrSInet 10. , . ' 

CI lents'.were administered the test battery. .The chief Instructor 
of the workshop was then asked to rank all subjects according to these 
criter-fa (he had no access to the test-scores)-: — l~.J?esRects^ author I ty 
and Is willing to take directions. 2. Generally completes assignment; 
work Is usually of good quality. 3. Seems to get along reasonably well 
with co-workers. 4. Learns new workshop skills without too much 
difficulty. ^ 

These rankings were not returned to the experimenters untU^'aj I * - 
tests'had been administered. Test results were as follow: -The ngIL , 
hypothesis (i.e., that thej^ ^s no significant rorrBlatlpn between ^' 
perfornance da the test' b^feVy and ranR:'I-nqs by 'the oh lef . Instructor) 
was rejected foP.;3ll ojnht tests.' Asmlohfbe expected, a high degree 
of overlap was noted thereby Indicating that the Instruments were . 
testing much the same thing., The' authors comment: "The correlations 
between t{ic 3ender Visual-'-1otor Ge.stalt (BG) rankings and .the criterion 
rankings Is excoptlona 1 1 y high and accounts for approximately 19% of ■ 
the total variance. On tfcbe basis of the BG alone. It would be possible 
.to predict rankings of wcrkshoo perfornanc^ for these subjects with a 
high degrdfe of accuracy.* < ^ J . 

SPEARMAN RHO^ I NTERCORRELATl-ONS BETWEEN EIGHT TESTS'-^ 
• AMD cf^lTERION RANKINGS ^OF WORKSHOP 'SUCCESS/ . 



Variables ^ [ ! Criterion Ranking 



O^XIonnor Finger Dexterity ^ .66(1) 

O^Connor Tv/eezer Dexterity .50(2) 

MiTinesota Rate of Manipulation Placing .64(1) 

Minnesota Rnte of Manipulation Turning .?3(2) 

Ac.tlve Sqore of the Hand Test" .37(2) 

(^odenouah'Harrls '"'raw^A-'-^an ^ .71(1) 

Bender Vlsual-iofor Costa It Test .39(1) 
Stanfo^d-Bine+ I? * .63(1) 



(1) Slgnlffcant at .001 level of confidence 

(2) Significant at .01 levehof confidence 
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. The fol lowfng-eons I derations should be noted In regard to this 
study: 

L Due to the smaJI size and qeographic I Imitation of the sample, 
'the~Buthors point out that It would be premature to cienerallze the 
findings. 

2.. The validity was concurrent, In other words the test battery, 
and the rating were done at aporoxlmately the same time. This makes It 
difficult to say that the test battery, ecu I d actually predict the 
performance ^In the shop. 

^"^^ ^ < 

* '^'3. The use of a single rater for each client may also have 
produced a olcture which did not accurately reflect performance since 
the ratfng might have been Influenced by other factors. 

4. .It should be noted that the study only purports to predict 
performance In a sheltered workshop. /Even Tf the. tests' predicted the 
criterion, a carryover prediction of competitive employment should not 

^be ma'de. * . - ^ ^ ' ^ 

« '( • <• 

5. The workshop In whtch the studV toolc d lace^appears to provide 
only'ben'chwork and woodwork I ngj-ypes of Jobs.'for^cl te.nts. The question 
mu'st.fJe raised whfether- the predlctlvenes^s of ^the varlo|js testMnstru- . 
mentS would be as- hlgK' In service areas'such as nal<ilenance aod^food* 
service*. - ► , ' * 

Although much additional research should hv^ carried on -bfefore" ^ 
drawing any generalized conclusions, the tost does appear to .encourage- 
further exploration of some of the test Instruments. . c . . 

Wagner and Hawver draw two far-reachlna Imol Icatlons from thelV 
study. First, ^hey fee:! that the stud^ I^nds some support: to the-^ 
theory tba+ .there !5 a slngfe ^Mntrsctness'' factor found In low grade^^ ^ 
mental defectives. In other words, thai' there .Is a single fefc^tor In 
retardation wnlch causes repression In all areas. of learning and 
perfbroiancc. The author^ base their c^ntentlan upon ttie high, degree of 
'correldtlonMetween the various test Instrarrents they used an.d the 
criteria Which they were suoposed to measure. Second, th^-^y see this 
high correlallon as suDportlna the validity of *'nsychoIogIcar' ' testl.nq 
with a retarded population even thouah they note that previous studies 
have failed ';o. reveal eauallv slqniflcant results. Wagner and Hawver 



^''Psychological' testing as used by Wagner and Hawver appears to 
have a more general Implication than Is usually ascribed Ho It. The 
authors apparently have used this title to cover, all standardized tests 
whether they would normally be administered by a* trained psychologist 
or a work evaluator. 

^ - 



.explain the low correlations of previous studios by suggestion: 
"Criterion measures may need to be re-evaluated.- 'Successful* ' 
predictions pay depend on the nature of the cr^terlon and/or who 
rates the writer I on/* CobbVquqtes several studies- which call 
attentlon^to this need for oB^ectl f Ica^-lon of criteria of 'success'. 

The size of* the Summit County sample md the fact that.determln 
/ tlon of "success ' was based on thojatin-^ of- a ?innle Instructor 
must necesaltate some caution In the uncritical accoptance of the 
results. \ 
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^Henry V. Cobb. F orec?^st of ,Fui f i 1 Imen t, od. clt., op, 9-11 
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WORK-SAU'LES 

.A work-sample Is' defined by Naff as a "mqjskrup, a close simulation 
of a^ actual Industrial o'peratlon, not different In Its esse^ntlals frocfi 
the kind of work a potential \pmployee wou.ld be required to perform on* 
an orvdmary job."' By definition then, the. work-sample, can actually be 
taken from- Industry or It.' can simulate an. Industrial .ogeratlon. 

Although a number' of evaluators fe«l work 'samples are superior to 
standardized tests, esppclally with- retarded ppp[u;latlDns,^ others feel 
standard tests reveal .as much If not more' tKan samples. 

'i- . . . ' 

Generally, the following arguments are presented »n favtw of work 
samples: (1) they are concerned with the same skills, aptitudes and 
abl I Itles". required by a lafger criterion task obtained from competitive 
Industry.^- (2) Because they more closely approximate 'reai 'work' Job 
samples will no't be subject; to some of the motivational problems 
evident on standard tests;5 (3) Many of "the Intt^uslve .factors which . 
pbtentlally affect test scores are less Ifkely to Influence work task 
performance. Included In these factors ett-e recency of ischool {.ng,. educa- 
tional deprivation, excessive anxiety, speefch and hearlnglmpalmfent, 
etc. 6 . • ■' ■ • • . -.■ ■ ' 
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Ray Sankovsky,, Gory Arthur, and Joe ttehn, (Materials and Information 
Center- -Alabatjia RehabI I ttatlon^ Media Servlc«ii AulJurn, Ala.) P-92 ^ • 

' ^William M. Usdane, Workshops for .tht Disabled. A Vocational 
Rehab 1 1 1 tat Ion Resource , quoted by Arthur D'. Burdett, "Ah Examination 
of Selected- Prevocat I ona I Techniques Utilized In H^ograms for the • • 
Menta 1 1 y Retarded" , Mental Retardation , (Au^i^t/ ,1963) p|x. 230-217.. ^ 



Ssakata and Sinick, vop\ elf. p. ^1 * 



^Daniel Sinick, "Client Ev.al.uat1on: Work Task Approach",- In 
Vocational Evaluation and Work Adjustment (A Book of ReadinqsJ^, --, 
op. cit. p. 88. 
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(4) -One re|)ort noted that prospective employers have been found 
generally more', amenable to reports of .work sample performance than to 
test scores "or prof 1 1 es. ^Demonstrated Job potentials- more readily^ 
lead to 'Job placement J F.InaHy, (5) Work samples are somewh"^at be'tter 
able to reveal not only skills required 6ut ajso aspects' of the cllent^s 
personality, Interest, .motivation and attitudes toward_ work.^ 

Theiorguments presented against a' heavy .rel lance upon Work samples 
are: (1) The resemblance of work tasks to actual Jobs Is no assurance 
that performancer.on one will predict perform^^.nce on the other, 
differ In many respects that cannot be duplicated In work samples.^ 
(2) The resemblance of work samp-les-tb actual Jobs may cause clients to 
believe they are fruly being trained for such Jobs.- This can ra 
false hopes on one side and also cause clients to resist certain Job 
samples because they resemble Jobs "I'l^^Y think they dlsl.Ike.^ (3) The - 
behaviors and attitudes noted throughout t^*© Job sample are-^subject* to 
the same subjective observatjon and Interpretations by raters as are 
other types of rating scales'! (4) Generally speaking /.there Is almost 
a complete lack of standardization of work samples. * Most facilities 
which use work samples have devised the I r^ own based on Jobs In their 
^worksf\pp or surrounding community and have not properly validated t^em» 

In the general f4"eld of vocational evaluation of the handicapped, 
tsom^ d^forts have .been made to Revise batteries of work samples which 
•WpuTd have unlvers^J significance. The 'TOWER'' series and "J EVS 'System'' 
'are. perhaps the b§st known. , . 

Although p few of PhJlarfelphla JEVS level IV^tasks^ and Isolated, 
portions of the TOWER couJd possibly prodiSce valid data forHMR clients, 
most of the work samples In these two packages are Inappropriate for 
'th Is* popu latlon. ' 

The Wide. Range Employment Sample Test (WREST) , .also titled the 
JastaR-Klng Worl< Samples^Is a recent deve lopment "of J.F.^ Jastak and 
Dorothy E. King and^ls produced by Guldatjce Associates of^ Delaware. 
The* normative data Is sketchy, "^Instructions are t:onf using and the set^, • 
appears Qverprlced; however^ the tasks Involvtfrf'^dan be accomplished 
by a significant percentage of^ T^Ws ahS. sheltered workshop norms are 

aval lable, • 'The battery W mdde-up of ten'b^^slc tasks 'described as 

m ■ • ^- ^ 



^Sakata and Sinick, op. clt.^^- ^ . ""^^ 
' ^sdane, op^ cl t . . . 



3sakata and SInIck, op., cit. ^ 



sik/qp., cft.^ p,89 
- V' * • 

^jey^T'^j/Emp joy^Qnf ^nd Vocational Stervlce,' Work4Sample Program 
Experimental and Di&6f)onstratI^ Project, (Jewish Empfoyment and Voca- 
tional Service, Phri*adelphlji^1968); D. 24. 
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follow: (1) Single, Double Folding, Pasting, Labeling and Stuffing, 
(2) StaplJjig, (3) Bottle Packaging, (4) Rice Measuring, (5) Screw 
Assembly, (6; Taq Stringing, (7) Swatch Pasting, (8) Collating, 
(9)' Color and Sf^de Matching, (10) Pattern Matching, 

The^ entire battery takes approximately one-and-a-ha]f hours 
administration time and requires no academic, ski II s on flie part of 
tho cl lent» • * ^ * 

A supplement manual to the WREST, published In 1973,' contains 
statistical data as well as the results of stxidles conducted^on specific 
groups^i One of these studies was conducted using a group of fifteen im 
students vTrtti the test administered three times at bly^eekly Intervals Jn 
an effort to assess the results of repeated adrrtlnlstratlons. Average 
number of errors was 45.47 on the first administration, 40,40 on the 
second and 44.33 on the third. Although the authors suggest the test 
be used as a training tool, they acknowledge that tKe results of theso 
retasts certainly do not Indicate startling fmpfovement (or significant 
practice effect for that matter) and suggest that the test be admlnls-- 
tered six' to ten times to produce significant results. They do not 
present data to support this suggestion. The authors also state that 
certain score levels attained on the first trial could be considered 
Indicative of employablMty as could certain steady gains from the first 
through succeeding trials. Data--are not given to substantiate these 
suggestions, however. 

Norms are given for both competitive and sheltered groups. 
Workshop (sheltered) norms are based on 300 clients of the Opportunity 
Center, Inc., In Wilmington, Delaware. No description of this popula- 
tloa Is given except that the center Is a "workshop for the mentally 
ana physically handLcapped''2. The authors describe their non- 
handicapped (compptltTve) sample "as a normal distribution taken from 
the .general population using a test of 'general ability' (WRIPT).-^ 

Normlng and statistical treatments are open to serious question 
as are some of • the sweeping statements made by the authors of the tests. 
Also, some of the Instructions for administration are obscure and con- 
fusing. Despite the obvious shortcomings, the test battery appears to 
have potential for use with TMR groups. 



1j. F. Jastak, Wide Range Employment Sample Test, Supplement to 
Manua I , (Guidance Associates of Delaware, Inc., Wilmington, Del.) 

. 2 The Jastak-KInq Work Samples Manual , (Guidance Associates of 
Delaware, Inc., Wilmington, Del., 1972) p. 5. 

^.:»3wido Range' Intelligence And Personality Test C/ff^IPT) formerly 
known as the Jastak Test. Further details may be obtained from 
Guidance Associates of Delaware, Inc. 



THE RATING SCALE 



Voctitlonal evaluation predictors c?n be expected to reach the 
greatest validity wher^ tt^ey clo<;ely approxinate both real work and a 
work setting. This o.hl losophy^has qlven birth to the 'situational 
evaluation'. Pruitt (1971) has defined situational assessnont as 
foilows: systema'tlc oroceduro for obsorvinn, record inn, and 

Interpreting work behavior.... anpMcabNr to a variety of real or 
simulated work situations, i.e., wor^kst^oos, Institutional job stations, 
work sample evaluation units. Industrial evaluation job sites, or In 
simulated work situations. "1 The focus of a situational evaluation Is 
not so much on ski 1 1 -potent lal but on the 'general work personality'. 
"Can the potential worker work at all? Can he conform to customary work 
roles? Can he take supervision? Can he net along with his ^co-workers? 
Can he put In an ordinary working day? How does he respond to demands 
to increase his productivity or Improve his quality?. Docs tio work 
better alpn'e or In the presence of others? Under what kind super- 
vision does. he work most effecilvely? Does he get so preoccupied with 
quality that he cannot produce at acceptable rates, or does ha try to 
work so fast that his Quality suffers? i/hat are his strenqths and 
weaknesses as a worker?"-'^ These questions become even more critical 
in the llqht of those studies which indicate that Job success or 
failure frequently is not determined nearly as much by objective 
factors as by the supervisor's impression of tlie c I lent.- 

It IsC of course, difficult If not i^posslhlo to accurately repro- 
duce a job settinq for evaluation purposes which completely approximates 
a competitive vocational situation, in most cases the best which can be 
accomplished realistically is the estabi ! <^.hnp^nt of a quas i -industr 1 al 
sotting providlnq the slrplest types of subcontract or prime- manufactur- 
ing. This simple. Industrial setting can, Itself, have a definite 
negative effect upon hloher level clients but apparently does not pose 
a serious problem at the TMR I eve I. ^ 



^ Pru ? tt , Situational Asse ssme nt: Princi ple s and F^rocess , ouoted 
Situational Ass e ssment: Models for the Future, Dennis J. Ounn, ed. 
(Research and "Tra 1 ni nq Center , Unlversitv of Wisconsin - ^tout, 
Menomonle, vHsconsIn, IO73) p, 5 

2v/alter Neff, "Problems of Work Fvaluetlon , P^^rsonnel and 
Guidan ce Journa l , March Vol. XLIV, ?Jo. 7, pp. rJs2-C^f^i ' 

^Donald W. Flske, 'Problems in Measuring Capacity and f-'erf orriance", 
Proceedings of the Iowa Conferenc e o n Pre-Voca tlona I A.cti v i ties , J ohn 
E. Muthard, ed., (Iowa City, l^fO), p. M 

■'Problems of Work evaluation'*, op. cit. . 
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Assuming that an appropriate setting can be establlshod, how does 
one assess performance In this type of ovciluatlon setting? Production 
•.(quantity and quality) can be objectively measured with a minimum of 
difficulty but much more Important Ih situational evaluation Is the 
assessRient of the cljent's response to a work environment, and work 
supervisory personnel's reaction to the client. The Instrument used 
most frequently to record and Interpret this Information Is a ratinq 
scale. The rater Is asked to chart his or her assessment of the 
clleni's work readiness. 

Dunn^ states that behavior ratino scales-make two assumotions 
"which lead to difficulty. The first assumption Is that categories of 
behavior are defined In a way that can be rated on a continuous scales 
This essentially means thatvlf we define a cateciory of behavior such 
as 'Velatlonshlp with supervisors" we have to come up with ^ way of 
scaling or rating client behavior on this catenory. This generally 
Involves the setting up of some continuum of "behavior" ranging from 
poor to good. Some behaviors Just do not lend themselves to this type 
of rating. Some -behaviors are either present or absent, either ^ 
acceptable or Unacceptable with no grey areas In between. 

Second, the ratinq scale can obscure situation-specific responses. 
For example, a certain worker's resoonse to three supervisors might be 
"excellent', equal to and quantitatively scored as "one" on the scale. 
His response to the fourth supervisor might be rated '"poor" 'which means 
a score of 'nine'". His average response to supervision then would be 
a three which completely obscures the significant conditions surrounding 
the behavior. ^ 

Recently, with jtbe resurgence of the applications of "learning 
theory", more reflneb observational techniques have become available 
and fhe reaoer is difected to studies by 3Ijou, et al., 1968; Flanders, 
1970; Peter, 1972; Tharp & Wetzel, 1969. 



The use of ratinq scales to chart behavioral observations raises 
an Interesting methodological question In re^iard to the present sfudy. 
The attempt has beenjmade to limit the scope of this survey to those 
studies Involvlnc TMR ponulations. Few ratinq scales have been 
researched specifically with this population, but should this preclude 
rating scales from cdnslderatlon? The criteria of which behaviors are 
acceptable for cnplcyfnent would seem to be sufficiently universal +o 
be required of all who are competitively employed. For this reason, 
an effort has been majJe to Include slonif leant research Involving 
ratinq scales used fop prodlctinq errp loyabi I Ity. 



^Dennis J. Punn, ^ItH^UPJ^ ^.sse ssf^ent : ^ ^bJelsJo r the Fut ure, 
op. c it.' 0.50 



ERLC 
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Th©^ Chicago Jewish Vocational Service^ Is often cited as a pioneer 
In the area of rating scale assessment of work behavior. Their Scale 
of EmployabI I Ity for Handicapped Persons Is the product of a great deal 
of research s^panning a period in excess of ten years. As Initially 
researched, It Involved a population of 1364 hanvjicapped clients of 
four rehabi I i tatlon centers: Chicago Jewish Vocational Services, 
Indianapolis Goodwill Industries, Kansas City Rehabilitation Institute 
and Cincinnati Jewish Vocational Services, Although the Information 
presently available pertaining to the study does not break the popula- 
tion down By IQ^ It- does appear that there were few If any TMR's served 
by Chicago J VST- 

The initial Instrument Included three scales. Counseling and 
Psychology Scales were filled out prior to the subject's entry Into the 
workshop. The Workshop Scales were filled out after a two to four- 
week diagnostic period, midway through the workshop program, aiid at Its 
conclusion, ^asis for item selection on the scales was not specified 
In the available Information, Scores were compared against three 
criteria of employment success: placement within three months, place- 
ment within one year, and maintenance of employment for those who were 
placed in the first three months. 

Correlations between each of the three scales "and the criteria of 
employment success varied from .13 to .49 (generally beyond the .01 
level of confidence) but "moderate at best'* (to quote the authors^) so 
far as actual prediction Is concerned. One reason posited for this was 
the moderate test-retest reliability (between .50 and .55). The 
authors suggested this was due to the hinh rrate of staff turnover and 
the resultant difficulty of maintaining rater training at the Chicago 
JVS where the reliability studies were carried out* 

Studies of each of the eighty-three Items of the three scales 
correlating) them witn the three criteria of employment success produced 
Individual Items which correlated, at a signlrlcant level with one or 
more of the criteria. These Items were combined Into clusters based 
on comr.X5n factors which had already been isolated. 

The significant clusters which c-merped on the Workshop Scale were: 

1. Attltudlnal conformity to work role^ 

2. Speed of productions^ 
3*^MaIntenance cf ouallty^^^ 

4. Acceptance of work demands^^*^ v 

5. Interpersonal ^ecurlty^^-^ 

6. Clerical abilltya^c 



^W. Gellnan, 0,J. Stern, and A, Soloff, A Scale of CnPloyabl I Ity 
for Handicapped Persons , (Jewish VocatlonnI Service, Chicago, 1963)* 
Also available in mimeographed summary. 



2|bld. p. 107 
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Counsel I ng Sea I e: 

- K Recem work history^ 

2. Appropriateness of job donands 

3. I nterpersonal conoetence^ 

4. Language fad I Ity 

. f>. Prominence of. handicap® 
6, Ethnic and rsclal Identity 



Psychology: 

1 . • Motor performance^ 

Ability to ora.sp Instructions and persist In carrying 
then out In o reasonably efficient nsnner^ 

3. Ability to be Involved In Interpersonal relations 



a = significant for early placement - three months after 

the conclusion of the program 
b = significant for olacement within one year after 

conclusion of the program 
c = significant for maintenance of emoloy^ent after 

It Is obtained. 



Copies of the Workshop Scale and the Counseling Scale (1^58 
revision) were obtained from Chicaqo JV5 in late 1973 (so It Is 
assumed that they reflect the current versions of the scale). The 
Workshop Scale Is comprised of fifty-two statements arranged under the 
following topical headings: "The Ability to Mobilize and Direct Energy 
in the Work Situation' (ten questions), includes comolainfs about self, 
eagerness to work, work drlvr^, steadiness of work (at different task 
levels) odd or Inappropriate behavior, willingness to work at unpleasant 
tasks. "Capacity to Tolerate and Cope-'wlth VIork Pressures, Tensions, 
and Demands" (seven auesticns) includes nunctua I i ty . conformity to 
workshop rules, relations with foreman, complaints ra: foreman, co-^ 
worker and tasks, acceptance of change. ' I ntorporsona I Relations with 
Co-V/orkers and Foremen' (seventeen questions^) involves social respon- 
siveness, supervision required, effect of correction, effect of 
pressure, participation in nroup structures, connunlcnt ion with fore- 
men, appropriateness of Interrelations with fore-'ion, acceotance of 
worker role, freeuency and intensity of resistance and neciatlve reaction 
to instructions, dependence upon foremen. '^unctlonloq Level of Ability 
In Work Situation' (fourteen cuestions) concerns itself with response to 
mistakes, organisation of work, comprehension of instructions, speed 
and accuracy at different levf^ls, manual dexterity and Limitations of 
handicap. •'Overall Evaluation: Aoency Criteria*' Is four summary 
questions concerning predicted placenent, work competence, work 
personality and ability to maintain employment. 
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Following Is an example taken from tho first section of the scale: 
5. Steadiness of work: more complex production task 

X. Information not obtained:- Task not assigned for 
reasons nofrelated to the c I ient* s^cprnpetence 

Y. Task not assigned because it wg^n^b'eT^lvearly 
beyond the client's compete? 

1. Y^ry steady worker durlng'entJre.'dal l^^work peclod 

2. Reasonably steady worker -duri nq ent I re x*^-ly work period 

3. Questionable or borderline steadiness dirlf^H^-'enti re 
da I ly^rk period ^ ^ * ' ^^-'i 

4. Inadequate or unsatisfactory steadiness duri n^\<Jrft;i re 
dally work period. ' 

Notice tiiat different r*^asons for not obtaining the Va/ticul ar 
rating in question are taken into account. ^ Unfortunately) many 
ambiguous terms are used such as 'very steady**, "reasonably steady", 
and "'Inadequate . Falling to provide objective criteria increases the 
probability of subjective ratings. Information on scoring was not 
Included In the material provided by Chicago, 

In 1970, Bolton of CJVS devised a revision of the Scale utilizing 
J.O. Taylor's method of scale construction. The result was an Instru-- 
ment composed of five continuum scales Identified as follow: 
1. Attltudlnal Conformity to Work Role; 2.,^Ma I ntonance of Quality; 
3. Acceptance of Work Demands; 4. Interpersonal Security; 5. Speed of 
Production. Only the workshop scale was revised In this manner and the 
author stresses that this Revised Scale is not Intended to replace the 
original Instrument but might prove useful "for assessing overall client 
progress for research purposes.'*^ 

The authors view the original scale as being statistically 
significant but not suf f IcIontly^Iscrlmlnatlve for Individual predic- 
tion. The fact that research .appears to be continuing on this scale 
would, however, produce the hope that the prrdictlveness of the scale 
will be improved. 

The /^ugust 107a issue of tho Train inn Sch ool Dulletln contained an 
experimental edition of a rating scale developed by Lloyd K. Daniels of 
Central Connecticut State College.* 



Mbld. pp. 12-13 

' I 

^Lloyd K, Daniel^', '"An Fxperlmental Edition of a r^atlnq Scale of 
Vocal-ional ^djustmr-nt for the Mentally ncrtardod", T rain I nq School 
Bui letin , (August, 1972) pp. 92-^8 
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Rationale for the development of this scale centered upon the 
authors contention that available instruments on the work behavior of 
retardates offer "limited evidence of either validity or reliability 
and rarely .lend themselves to convenient or accurate quantification. 

Development of the scale beqan with four hundred statements 
chosen from other rating scales. These were thon screened for content 
validity by three Judges, each professionals (post-Master Degree level) 
In the field of rehabilitation. Content val idltv was based on applica- 
bility to MR's, usefulness of the Information contained and whether It 
described positive or negative behavior. Complete agreement was reached 
on one hundred twenty-seven items which comprised the scale with choice 
categories from "Usually" true through "Seldcn'" true with appropriate 
value weights. There was also an "Undecided' or "Uncertain"' category 
with a neutral value. This scale was used on a sample group and an 
Item analysis conducted upon the results. Ninety items were found to, 
be significant at the' .01 level and were selected for the Vocational 
Adjustment Rating Scale (VARS), forty-two reflective of positive voca- 
tional adjustment and forty-eight of negative. The vocational adjust- 
ment criteria used to validate the Items were not Indicated. 

The scale was further broken down Into those Items. Judged (by^ 
three psychologists) to be directly re.lated to work success and those 
Items Indirectly related to work success. 

Reliability was ascertained by comparing scores of three rators 
who Independently assessed each of a group of trainees. The raters 
received thorough Instruction and practice In the-use of the scale as s 
well as having the I rv attention called to the common types of. rating 
errors such as *'Halo" effect. 2 This was done In each of four Job 
areas with reliability varying as follows: 



Vocational Adjustment 
Measure 


1 

Grounds 


Training Department 
Kitchen Housekeeping 


Retal ring 


VARS Direct 
VARS Indirect 
VARS rTota 1 


.97 
.88 
.92 


.77 
.86 
.84. 


.88 
.96 
.95 


.71 
.67 
.57 


Tra 1 nees 


12 


12 


11 


5 



kloyd K. Daniels, James A.. Stewart, "'Development of a Vocational 
Adjustment Rating Scale for the Mentally Retarded", Training School 
Bui letin , (May 1971) p. 10 - ' 

2Lloyd Keith Daniels, The Relation Between the Self Concept, 
Perceived Parental Behavior, and Vocational Ad.lustmont ^or Mentally 
Retarded Young Adults , (unpublished Doctor's dissertation, Boston 
University, 1969) pp. 76-77 



The test population was composod of forty young adult nales 
resfding with their parents but enrolled in the North Reading Rehabil- 
itation Center, North Reading, Massachusetts, Acjc rarqo wns 17 to 28 
(mean=19.76) , !0 (Stanford 1^5 net) rannod from ;0 to 80 with a mean of 
64.53, The four training areas wore selected because they contained 
sufficient staff to provide the necessary throe ratcrsJ ; 

The basic weakness of the study is that It was merely a small part 
of a project designed to study the relatlonshlo between self-concept 
and vocational adjustment. For this reason t^^c custcnarv efforts to 
^ establish predictive validity for the scale were- not carried out,- 

. It Is unfortunate in this regard that the 1972 Training Schoo l 
3ul let in article closes with the connont that the * list can be used.,, 
to enlighten.,, staff regarding the current ?nd r^otentlal emoloyabi I I ty 
s of nentally retarded trainees**,'^ since th(?Ge clal'rs are not supported 
through research. 

Some question could also be raised concerning ^ho apparent practice 
of ascribing ecual weights to items of unequal linportance. In other 
words, In the scoring, a high ratln<i on **Can Cnijnf (I ten 123) Is just - 
as significant as a high rating on "Accepts Suoervlslon** (Ite^ 77), 
It is noted in reoard to the lat'J'or I ten, however^ that there are* 
several other items which deal with the '--a^.*^ General area of acceptance 
of supervision thus *'welqhlpq** the factor to a certain extent. 

The scale Is not available In puDllshed fom and Its author 
recommends takirfg the material presented In the August 1972 Issue of 
The Training School ! :.ulletin (Oanlel*".) and reconstructing the scale 
from It if exoloratlcTn wl th tho scale Is desired, A letter from Dr. 
Daniels has indicated that several orouos are using the scale for 
Investigation of different populations so additional data mav be forth- 
coming. Although the studv has qood d^^slqn and face validity, 
statistical validity needs to be determined. 



WO^K H A3 its SCALE (PO'^TION OF THE VOCATIOrjAL CAPACITY SCALE) 
-''VacDonald Training Center Foundation, Inc. 
-Available From: "acPoriald Tralnlnq C'^ter foundation, Inc, 

4424 Timpa ^av Olvd 

Tnnoa . ^ lorl .la 3"624 

The Work Hnblts Sc-^le Is one of the ts?':ir^ -md scales which comprise 
the Vocational Caoacity Sc.-^lo devolopoj y\ tho V-acLonaiO Tr^lninq 
Center. The purpose of thv- '^r.tiro orojoct. known froojently a^-. the 



Mbld. pp. 4R-4V 

- ^Daniels, "An Fxnor tnnn t'-il -dlti-^n of ^ '^atln^ Scale, 
on. clt\ p. 90 



Ferguson-PInkard project, was to "develop, validate, and standardize a 
vocational capacity scale which would 'assess the training assets, limi- 
tations and potential of younq adults handicapped by mental retarda- 
tion."' A discussion of the entire battery will be found !n the section 
on COMPREHENSIVE TEST BATTERIES and will not be duplicated here. It 
should be noted that the authors do not encouraae the use of Individual 
portions of the VCS, such as the Work Habits Scale, as solo predictors. 

Revision of the VCS in" 197? and subsequent validation Indicate 
that the Work Habits Scale has the highest correlation with supervisor 
ratings of the final status of the clients of any of the portions of the 
VCS (.42). 2 

The Work Habits Scale consists of thirteen Items under four general 
headings as fol low; 

LEARNING AND COMPREHENSION PERFORMANCE 

U Response' to. Instruction * U Frustration Tolerance 

2. Concentration 2, Consistency of Effort 

3, Adjustability to New Job Tasks 

ATTITUDE TOW ARD WORK INTERPERSONAL RELATIONS 

1. Adaptation to Work Environment ' 1. Reaction to Supervision 

2. '^tlvatlon to Work 2, CooperatI veness with 

3. Reaction to Pressure Supervisor 

4. Punctuality 3. Relationship with Peers 

5. Work Interest 

Four descriptive statements are listed under each Item. For 
example, the four listed under "Motivation to Work" are: 1. Usually 
looks for things to do; 2. Sometlf^es will look for things to do; 
3. Rarely looks for something to do; 4. Constantly has to be pushed 
Into doing something. 

This Item, as many others In the scale, uses the ambiguous terms 
"usually'', "sometimes", etc. Supervisory opinion will vary as to what 
constitutes "sometimes" thus damaging the objectivity and reliability 
of i^he scale. 

Total score on the scale Is divided Into quartlle ranges and 
Interpreted as follows: " \ 

Ouartl le 1 Day Care 

' Quartlle 2 Sheltered 

Quartlle 3 ' ' Bc^rderllne 
Quartlle 4 , Competitive 



^Cobb'> Vorecast of Fulfillment , op. cIt. p. 73^ - 

„2c.x, .Ho; "A Validation Study of the Vocational Capacity Scale 

for the Mentally Retarded Young Adults", (MacDon^Id Training Center 
Foundation, Inc., T^^mpa, Florida, 197?) p. 3 
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Again, It should be remembered that the final quartlle rankings 
are b^sed on the combined scores of all the eight tests and scales 
which comprise the Vocational Competence Sc^le. 

WORK ADJUSTMENT RATING FORM (WARF)^ 
-Bitter, James A. i Bolanovlch, D,J. 
-Availability: Printed In March 1970 AMJD. 

' Other availability unknown. 

The Work Adjustment Rating Form (WARF) was designed to ''predict 
Job readiness of retardates." The authors desired more -'sped flea My, 
to design a tool which would provide (a) a systematic 'observation, 
(b) relevance, (c) rel labl 1 1 ty of observations and (d) Identification 
of behavior patterns. i 

The study was conducted during 1964-1966 at the Work Experience 
Center, St. Louis Jewish Employment and Vocational Service. ^The con- 
ception of the form and the criteria used In Its composition were not 
clarified In the AJMD article. Instead, the article Is concerned with 
validation of the form on a population of forty clients In light of 
the four 'criteria mentioned above. Criteria for selection of the forty 
clients are also uncertain, however, the basic statistics for the group 
are as foljows: mean ago 19.41, range 15.92-19-83; ne^n 10 59.25, 
range 39-84. 

Th*^ forms were completed by three counselors and one foreman after 
both the third and sixteenth week of tralnlnq. ^ 

The WARF contains eight scales, each broken down Into five levels 
of performance. Performance levels are scaled so that a posl+lve 
response at one level also should be counted as a positive response 
to levels below. ' 

The eight subscales are: (a) Amount of Supervision Required, 
(b) Realism of Job Goals, (c) Teamwbrk, (d) Acceptance of Rules/ 
Authority, (e) Work Tolerance, (f) Persev^^rance In Work, (g) Extpnt 
Client Seeks Assistance, and (h) Importance Attached to Job Training. 

The breakdown of one subscale was also Included In the artlclf^. 
Under "Amount of Suocrvlslon Required** the following five levels are 
listed: 1. Client works with difficulty, even under constant super- 
vision and after getting considerable training. 2. Client can work 
on his own after thorough training, If his work Is frequently 
observed and checked. 3. With training and direction, client can work 
Independently under occasional supervision. 4* Once shown what he 
must do, client applies himself diligently without much , supervision. 



Y — ^ 

Ijames /. Bitter and i^.J. ^^olanovlch, "WARF: A Scale for 
Measuring Jyob Readfness ^Beh'ivlcrs" . American Journal o^ Mental. 
Oeflejrpcy/ (M^^rch 1970). .^ol- 7^1, Mc. 5, ^o. 



5, Client catches on easily and does his work with practically no 
suporvisl-c/n. When these Items are presented, tho.y^ are oresented in 
scramblod/order and the level and scale of Items are not known bv 
raters, - ' ^ * , 

Correlations were run between counselor ratings-, after both three ^ 
and sixteen weeks, and job, success, . Correlations were also run Involv-^ 
inq one counselor and the foreman (the only two for-whom sufficient 
data existed) pertaining to, each subscale of the test and eventual Job 
success. Job success was measured &s six months of community employment- 
following the 36-week St, Louis J EVS training program, ^ 

In general, the WARF ratings (rank order) corresponded to the 
counselor's pooled Judgment or employabi 1 1 ty at the end of the thirty-^ 
six week training period, and actual Job ^success as determined by sl,x 
months employment. These correlations, broken down for each subscaie, 
are noted below,' « 



Subscale 



Amount of Supervision 
Real Ism-of Job Goals 
Teamwork 

Acceptance of Rules 
Work Tolerance 
Perseverance in Work 
Extent CI lent Seeks 

Assistance 
Importance Attached 

to Job Training 





Criter 


OI\ 




Job 


•Success 


■ Pooled Judgment 


Counselor 


A Foreman 


Counselor A 


F.oreman 


.57 


.51 


.78 


.58 


.67 


.52 


.90 


.63 


• .16 


.50 


.47 


.53 


.35 


.10 


.57 


.15 


.26 


. -.04 


.48 


-.04 


" .60 


.65 


• = .81 


.70 


• -.34 


.46 


-.34 


.47 


.69 


.70 


.47 


.76 



Actual statistical significance of these phi correlations cannot 
be determined with the available data. 

Although this Is listed as a forty point rating scale. It actually 
has .the effect of only an eight point scale since the qu?3st!ons are 
grouped as five levels under each of eloht questions, ^ It would appear 
that this would severely limit the reliability of the'scale by Insuffi- 
ciently sampling each behavior area,^ Jhe format of the WARF also 
gives equa! weight to each of the ^Ight scales. In light of the results 
of the study, especially as recoff^ed on the table, a weighed version of 
the scale might be In order, 

A biserlal correl^atlon was computed between counselor ratings at 
the end of three and sixteen weeks and Jobsucdess, Three of these 
reflected some Increase In oosltlve correlation, one rofloqted some 



'victor H. Noll, Dale ^, Scannell., hvtroductl on to Educ ational 
'•^easureneat. Third Editfon, (Houghton Mi f f 1 1 nT '3o<->ton . 1972rr, 145 
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decrease In positive correlation. Significant differences In the 
number of clients tested at each time by each rater make the correla- 
tions relatively useless for determining the extent to which the 
additional thirteen weeks of evaluation Improved prediction. ^ 

This Is the shortest of , the rat I no scales reviewed. According 
to the authors It can be administered In three to seven minutes and* 
scored In five. 

The authors cite as the primary needs for further research: 
Identification of specific behaviors^ attainment of observer consist- 
ency, and the development of normative Information relative to 
predictive behaviors. 

. . ■ . ' . J 

SAN FRANCISCO VOCATlbNAL COMPETENCY SCa'^ 
-Levlne, Samual i Elzey, Freeman F. 
San Francisco State College 
-Aval labl Hty: The Psychological Corporation. 
New York, N.Y. 

The SFVp was developed as an assessment tool for describing the 
vocational dompetence of mentally retarded adults. The authors 
picture It as useful In selection for training, assessment, of status 
at a given Time, Judgment of growth over a period of time, and screening 
for placement.^ c 

The sqale contains thirty^ Items each followed by four or five 
descriptive statements representing varying degrees of competence. 
.The lovelslare meant to he cumulative In tshat a high level ^presumes 
competence on preceding level^s. The Items relate to: vocational 
competence - motor skills, cognition, responsibility, ?»nd social-, 
emotional -behavior. 

. The scale was developed around responses to questionnaires received 
^om sixty-elqht workshops containing mentally retarded populations. 
These were coupled with Interviews" and observations to determine those 
behaviors necessary to the development of vocational competence. ■ 

Two pretests, each Involving 330 individuals, wore conducted to 
produce the thirty Items. These were then normed using a population of 
S62 mentally retarded Individuals In fortv-flve workshops representing 
all geographic areas of the United States. 

The th^Irty Items on the test apnear to have faCe validity so far 
as the^ purposes for which they were Intended. Once again, however, many 
of the answers are In amblquous terms such as "Hardly evor**. 



^Samuel Levlne A Freeman F. EI20V, Manual: S an Francisco Voca r. 
tlonal C o mpet e ncy Scale , (The Psychological "Corporation, Now York, 
1968) p. 2 ' " 
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'*p^equent^y•^ and '•Occasionally". The oroceduros used for oretestlng 
and norminq the test appear appropriate. The only question which must • 
be raised porta lolnq to the construction of the 'test Is In the scorlnq. 
After each Item has been scored (usinq the four or five descriptive 
phrases) the scor'es are added and averaged. The responses must bo 
classed as an "ordinal'' sca^'Ie meaning that the relative *d I stance between 
a' 'one' and a 'two' may not be the same as between a ^two' and a 'three* 
and so forth. Therefore,' the' average of a one and a three might very 
well not equal a two. This makes It unwise to place too much we.Ight 
upon a score which comes as the average of these ambiguous figures. ' 

^ N.M. Downle, In reviewing the SFVCS, calls I-/a "potentially 
"^jseful scale" but stresses .that "Fbl low-up studies should be made on 
those^placed XDn Job's In the communIty'\2 Further studies will' need to 
be made, at least on a local basis, before the Scale can be used for 
some of the^p'urposes Its authors propose. The only norms supplied In 
the manual (1968 edition) are percent'IJe comparisons with the noming* 
group of 567. Th.Is, of course, provides no real basis for selection 
for training on screening .for placement* Although the Scale has use 
. in test-rotest situations, -additional norms must be established to 
estabi Ish predictive .val Idlty. 

. • ^ 
.VOCATIOMAL ADJUSTMENT RATING SCALE FOR RETARDED3 
-Song, R.H/ i Song,. A. Y, 
-Aval labi I Ity \jnknown#- 

Song and Song list as the prl'mary objective of their work "the 
development of a vocational adjustment scale to* measure how a client 
actually oerforms'and his. specific behaviors In all types of work ^ 
settings". • Upon^ completion of tl|e Instrument Jt was used to test a 
pripary hypothesis that retardates classified as better workers In 
scale- ratings provided by work supervisors* 

The test population was composed of 113 clients of the Rosewood 
State Hospltaf Vocational Rehabilitation Centv^r In Owlngs Hills, 
Maryland. Tne IQ range of the population was from. 36 td^ 76 with a 
"Median of 57. Client ages ranged from 15-44 with a median ^of 2\. 



I R.J. Se.^+er, Analysis of Data , (Scott, Foresman and Comoany, , 



Glenvlew, I I L. 1969), p. 11 



2t^.M. HownPe, In The Seventh Mental Meas uremen ts Yearbo ok, ^ ; 
Oscar Krisen Quros, Ed, (GryohblT'Press', Highland "Park-. Mew Jorsoy, 1972) 
,0.^4.97. , ' ' _ 

5r.H. Sonq and A.Y. Sonq, Jeveloonent of a Vocational Adjustnent 
Rating Scale tor the Retarded', Journal of Counsel ing Psyc ho lonv, 1971, 
Vol. 18', No. 2, pp. 173-176. . ' . 
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The scale Is divided Into five areas which are essentially based 
'on the Anerlc3n frssoCiation Mental Deficiency's study by lleber of 
Important behavior variables of retardates. 

The five areas and the number of items under each are as follows: 
1. Work Ability (9); II. Work.Habits (14); III. Withdrawn Tiohavlor (9); 
IV. Aggressive Behavior (10); V. Bizarre Behaviors (10). Answers are 
recorded on a five point continuum ranging from, "very poor** to 
"excellent" in Areas I a,nd 1 1 and from 'Very often'' to ^'never'* in 
Areas III to'V. Raters were asked to assess every item and no weighing 
of the Items was done. 

Reference point for the scales was what the authors termed the 
'average worker" In a particular work setting. No mention was r^ado of 
the criteria used to define or determine the average worker. 

A » 

I 

The validity cri terlon used was independent classification of the 
workers as 'excellent', 'good ' , J^falr\ 'poor', and 'very poor'. 
This, apparently was done by the same supervisory personnel who had 
completed the rating scale and therefore tne results are possibly 
affected by 'cont^mInai"Ion ' or carryover. For this reason the high 
correlation achieved Is suspect. ^ . 

Forty-five of the test population were placed In community employ- 
ment for a minimum of two/, weeks.- At the end of -this period their 
employers werel asked to rate them on a continuum from 'very poor' to, 
'excellent'. Even after this short per hod of time, only scale number^ / 
two (Work Habits) displayed predictive validity (r=.42). The authors 
blame this at least partially ori differences in criteria between that 
of the Workshop and that required ton the job. 

Basejl„on the material contained Ip the article; t% scale does 
appear to differentiate between two gVouos of worl<ers with In a ^sheltered 
setting but the actual prodlctlve value appears qulte^ limited. ) 

' ' ' 'I 

Additional research, if and when available, may result in dlyf^erent 

usions. / 

/ 

/ 

T.M.R. PERFORMAMCE PROFILE / 
for the Severely and '4oderately Retarded 
-Alfred J. DINoIa, Bernard P. Kamlnsky, Allan, 
. Stdrnfold 

-Available ^rom: Reporting Service for Chlld^'en 
563 Westvlew Avenue 
RIdqofioId, Mew Jersey 07,^57 

The T.M.R. Performance Profile Is a rating scal-e which results In 
^assessment In the areas of: Social Behavior, Sel f-CaVe/Communlcatlon, 
Basic Knowledge, Practical Skills and- 'lody Usaqo. The 'vtanual states 
tpat It was developed "by classroom teachers out of the-problems and 




needs of the classroon teacher" to ascertain present functlonjng of 
"severely and moderately retarded children and young adults". 

The profile resulting from the scale has not been compared to 
outcome criteri,a, although a "roalisMc goal" level Is listed at the 
^three' level. (Each scale runs from zero to four). Definition of 
'realistic goal' and what it means in terms of such things as independ- 
ent living and employabi I i ty Is not discussed. Other than implying 
that some goal has been reached at level three, the profile is consist- 
ent in its expressed ^aim of only evaluating the pupil's performance 
--^•against'^hl s own prior achievement. 

TheScaia is compreKensive in the variety of traits which it re- 
cords and it'contains a great number of items which would relate either 
directly or indirectly to employabi I ity. Examples of employment- ^ 
related Items are: '^Stabi I ity", "Response to Autho'-ity Figure", ^ 
"Response to Criticism", and "Change, in Routing" under the "Social 
Behavior" section; numerous questions pertaining to use of various 
tools, under "Practical Skills", and an entire section on "Vocational 
Readiness". 

It would appear, therefore, that with sufficient research and 
validation this scale 'could be developed into a predictive tool for 
employabi I ity in either shel+orodor competitive settings. If this 
type of research is attempted, appropriate statistical studies sliouid 
accompany it to determine which factors have no bearjnq on employ- 
abi Hty and which. If any, should receive additional ' weiqhti ng in the 
^coring. ' 

Some Items appear. In almost Identical form. In more than one 
area thus ''weighting" the Item in relative importance. Nowhere do 
the authors Indicate whether this is intentional or v/hettior It 
adversely affects the validity of the test. 



^DlMola, Kanlnsky and Sternfeld, "T.M.R. Perfornanco Profile for 
the Severely ^nd ^'odcrately ^c-tardod: Teacher''^ **anij?»K' (rdiiCTtionajI 
rerforrorcf^ A^.^ociotes, ^Mcofield, i:.J. 19^*^.8) p. iil 



COMPREHENSIVE TEST BATTERIES 



There have been several efforts In the field of work evaluation 
of the retarded to produce batteries of tests which assess the perform-- 
ance of clients on a variety of tests and scales and^hen combine these 
results Into a single predictive score or profile. Although the 
majority of work has been undertaken with EMR or mlldny retarded 
populations, there are at least two studies where evidence has been 
presented to validc^to these methods with TMR populations. 



VOCATIONAL CAPACITY SCALE' 
-MacDonald Training Center 
-Available from; MacDonald training Center 
4424 Tampa 'Bay Blvd. 
Tampa, Florida 33614 

The Vocational Capacity Scale (VCS) was not constructed using a 
TMR population. However, the subsequent follow-up by Maurice Dayan at 
the PInecrest State School, Pinevllle, La., utilized a substantially 
TMR group.^ 

The Vocational Capacity Scale Is essentially the development of 
Ferguson and PInkard and reflects a more or less continual project 
beginning In 1959. 

As Initially designed, the VCS was comprised of eight miaasures 
described as follow:-^ (A) Work Habits - A rating scale, developed 
and standardized at the MacDonald Training Center Sheltered Workshop. 
(This Is discussed separately In the chapter oh Rating Scales.) 
(B) Physical Capacity - An adaptation of a scale taken from '^Estimates 
of Worker Trait Requirements for 4,000 Jobs" (U.S. Department of Labor, 
Bureau of Employment Security, United States Employment Service - 
U.S. Department of Labor, 1958). (C) *"The Vine land-Social Maturity 
Scale., (D) General Health - A ratlno form developed and standardized 
at the! MacDona Id Training Center. (E) Manual Skills - Derived from 
"The Pennsylvania Bl-Manuol V/orksample.*' (See description In appendix). 



^MacDonald Training Center, Predicting Vocational Capacity of 
Retarded Young Adults , (MacDonald Center, Tampa, Florida 1963). 

^Maurice Dayan, Validation of the Vocational Capacity S cale 
Utillzinn Institutionalized Retardate s (unpublished research project. 
Training and Research Deoartmrnt. PInecrest State School, ^Inovllle, 
Louisiana, 1%r). fMcroflche: FD073552. 

^r'acDonald Train Inn Center, "Vocational Capacity Scale'', (Mac- 
Donald Tralninq Center, Tampa, Florida, 1963) pp. 11-13. 
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Only the Assembly phase of this test Is used. (F) Arithmetic - This 
Ifector Is. derived fron the arithmetic portion of the Wide Range 
Achievement Test. (G) N!otIvatlon - Disc Assembly Test, an unpub- 
llshed measure of motivation and sustained interest developed at the 
MacDonald Trainino Center. (H) Direction Following - Wells Concrete 
Direction Test. This test presently is not pubj.ishod. 

Subsequent research by Ho' revealed th^t physical capacity,^ 
general health, and motivation, as ad'^i n I stered In the VCS were 
not significantly preJictive to warrant their continued inclusion. 

The test Is us^d to predict various levels of vocational potential 
of the retarded. The potential was seen In terms of three criterion 
groups: Competitive Employed, Sheltered, and Work Activity. The^ 
Competitive Employed Group was defined as those who had obtained and 
held competitive employment for a period of more- than six months. The 
Sheltered Group consisted of those who had noj- achieved competitive 
employment after a period of nine months in a sheltered workshop. 
However, they wore functioning adequately In a sheltered work situa- 
tion. The Work Activity Group consisted of those who, followlna evalua- 
tion and training over a nine month oerlod, had not been able to 
maintain the standards reguired for sheltered employment and had been 
dropped from consideration of candidacy for apprenticeship In the 
sheltered workshop. ^ (^lacDonald also ostabMshed a "Borderline'' group 
between sheltered and competitive. This was the result of overlap In 
^ the VCS scores of the two groups.) 

Because of the EMR population of the MacDonald Center It Is not 
necessary to enter Into a detailed description of the normlng and vali- 
dation work which was done as part of the brlglnal project. Several 
authorities in the field have looked at the oroject in depth and 
serious questions have been raised concerning some of the procedures 
Involved. ^ 

Windle in his review of literature In the fleld^ states^ that the 
MacDonald study has such serious methodological ^shortcominas\that It 
is worthless as a predictive study. He notes in particular: ^^Crlterla 
of vocational success, actual level of operating efficiency, was 
defined by the place^iont of the client within or outside the shbo. 
The grounds for placc^^^nt may not be Independent of the descrlptWe 
characteristics of the client and therefore retrospectively related to 
placement." What Windle Identifies is what is freauently descrlb^^ as 
3 *'sel f-ful f 1 I I inq orophecy". In Its most obvious form this would 
entail placing a client at a certain level due to his performance on 



^C.J. Ho, CD. cit. 
"^Oay^n, op. clt. p. 2 

v/lndle. '^Vognosis of ''ental Subnormals", A merican Journal 
of Mental Oeficiencv, Monoaraph Supplement, 19^?, pp. ISOf 
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a test battery and then using the placement to establish the validity 
of the test battery with no consideration as to whether the client 
might have performed even better at sone other level. WIndle also 
object?; to Ferguson's use of Chi sQuares with the unequally sized groups 
used In the study. He states that these resulted In iow expected 
figures In too high a proportion of cells for the statistical test to 
be meanlncful, WIndle also notes that some computations are Incorrect. 

T^Dayan project, released In 1968, was a three year project aimed 
validating the Vocational Competency Scale using a population of 
mentally retarded young adults In a residential Institution. The age 
range of the population was similar (1!5-30 for the PInecrest sample vs. 
16-30 for the MacDonald sample). A rough estimate of the mean IQ of 
the PInecrest study, based on available Information would be 44. Mean 
for the MacDonaJd study (full scale WAIS) was 66.36.^ 

The three hundred and sIxty-sIx residents Involved In the PIne- 
crest study were each administered the VCS twice, one year apart. 
Administration of four of the scale Items was done by three college 
students trained forthat task. The Social Maturity measure was admin- 
istered by the executive assistant of the project staff, the work 
habits ratings were comoleted Independently by three staff members 
(usually cottage parents and the resident's supervisor) as was the 
physical capacity scale. The general health form was based on Informa- 
tion from a cottage parent, a work supervisor and a staff physician. \ 

Following the administration of the test Items, the clients were 
Involved (or continued to be Involved) In the various programs of the 
facility. Judging from Inferences In the Dayan report and the care 
taken to avoid contamination, the VCS scores were not used. In making 
program determinations. If this !s the case, the main objection to 
the MacDonald study was avoided. 

During the two years foHowIng the Initial testing, a social worker 
collected data on the movement of all subjects within and"outslde the 
Institution. Six months prior to termination o< the research project, 
upon careful analysis of client movement and per I'ormance In various 
programs, subjects were assigned to one of the three criterion groups. 

Findings of the project are presented as follows: 

DETAILED DESCRIPTION OF EACH 'CRITERION GROUP 
SAMPLE BY: AGE, 10, SEX, AND RACE (N=322) 

Competitively 

Employed Sheltered Day Care 

Number (N): 20 (6<) 739 (74?) 63 (19?) 

f^an 21.14- 22.19 20.13 

AGE: SD 2.78 4.24 5.05 

Range 15.3-25.8 15.0-30.6 15.0-30. c 



'^^cOonald Training Center, "Vocational Capacity Scale", op. cit. d4 
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DETAILED DESCRIPTION OF EACH CRITERION GROUP 
SAMPLE 3Y: AGE, IQ, SEX, AND RACE {N=322) 
(Continued from precedlnq page) 







Competltl vety 
EfTiDloyed 


Sheltered 


Day Care 


10: 


Mean 
SD 

Range 


62.8 

23.19 

32-80 


42.65 - 

14.28 

12-98 


•25-58 


SEX: 


Male 
Fema 1 e 


17 (9?) 
3 (2%) 


134 (12%) 
105 m%) 


36 i\9t) 
■ 27 (20<) 


RACE: 


White 
Negro ij 


19 ni) 
i 1 n$) 


184 (72",) 
. 55 (80!t) 


51 (20<) 
1? (17f,) 



Dayan Indicates that -tKe slqnlf leant findings revealed by this 
table are as follow:* First: There Is ^poarently little or no 
difference according to age. This Is not surprising due to the range 
limits Imposed by the construction of the study. Second: There Is 
some relationship between 10 and levfti of employment. The fact that 
significant variability was found In the competitively employed group 
Dayan Interprets to mean that other factors beside 10 contribute to 
competitive employment potential. Third; Disproportionate percentages 
of females and nenro^s were found In the conpetl t I vel y employed group. 

Comparisons were also' done 'between the mean scores of each VCS 
measure and the various criterion groups. The differences were all 
found to be In the same direction; the comootl tlvely employed had the 
best scores, then tho sheltered shoo group, and then the non-enployed, 
day care group. The on-ly exception was General Health. Physical 
Capacity was also found to be a weak measure. It reach^ed the .01 
level of significance between the competitive and non-employed, but 
only .05 between sheltered and non-employed. The difference between 
competitive and sheltered was not significant. 

As noted, all other comparisons showed mean differences which 
reached .01 or. better. 



ERIC 
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COMPARISON OF CACH VCS 'CASURE WITH 
THREE C!5:iTERI0N GROUPS MEAN SCORE 

A n C 





Compet i t i ve 1 y 
Eoip 1 oyed 
(N=20) 


Sheltered 
Employed 
(rj=239)a 


tJon- 
Emp loyed 
(N=61)'5 


T-ratlos and 
Significance Levels 




MEAN 


S.Di 




S.D. 


MEAN 


S.D. 


A-C 


A-B 


B-C 


WH 
PC 


20.90 
^15.48 


4.63 
.77 


28.34 
13.44 


7.69 
2.51 


37,49 
10.59 


9.73 
3.13 


10.09 • 
3.79 


D. 34 
.85 


^ "77* 

2.36** 


SM 


83.15 


6.21 


71 .83 


8.57 


58.90 


8.38 


13.55* 


7.42* 


10.69* 


GH 


3.7-7 


.33 


3.31 


.68 


2.53 


.83 


) J5 


.53 


.72 


MS 


404.80 


■60.42 


846.79 


473.93 


1579.06 


610,43 


13.30* 


13.03* 


" 7.91 


AA 


3.27 


.99 


1.7n 


1.24 


.75 


.87 


9.97* 


6.53* 


6.85* 


DA 


48.30 


11.20 


2B . 34 


13.79 


13.21 


0,00 


12.24* 


7.30* 


9.74* 


OF 


31.60 


14.74 


12.9r^ 


13.02 


1 .Gr, 


5.20 


8.60* 


^.32* 


9.26* 



3Exceptlons are: •^S=235, AA=?38, DA=234 
bExceptlons are: MS=50, DA=52, DF=58 
^Significant beyond ,01 
**5ign] f leant beyond .05 but not reaching .01 

m = Work Habits 
V PC = Physical Capacity 

SM = (VIneland) Social Maturity 
GH ^ General health 
MS = Manual Ski i ts 
AA = Arithmetic 

DA = Disc Assembly {'Motivation) 
DF - Direction Following 

The ciuthor points out that Social 'Maturity (SM) was the strongest 
measure In d I f f f^rent I at I nq between the competitively emoloyed and the 
non-em0loyed. Manual Skills (MS), Disc Assembly (DA) and Work Habits 
(WH) were also stronq. Social ['Maturity also was the strongest measure 
wheg comparing the sheltered with the non-emnloyed. 

An anrily$ls factors measured by the VCS revealed that most of 
the measures were Indooendent of each other. Direction Following was 
found to be related to ^>^anual Skills and Arithmetic Achievement, 
Physical Caoaclty and General Health were related only to each other. 
The general factors which appearod to be reflected by the VCS were: 
non-Intel lectua I routine work, 1 nte I I 1 jence, physical canaclty-health, 
and soda! maturity. 
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Unlike tne MacDonald study' which resulted In a compos I te^woighted 
score,- Pl.neland used a standard score approacn. Scores oh each of the 
eight measures were converted to standard scores iz) . It was found 
that there was no overla.p of scores within one standard deviation of 
any mean. Using one standard deviation as a cutoff the VCS (In the 
Dayan study) would have predicted 85^ of those competitively employed • . 
The predlctlveness of the total score as compared to Individual predic- 
tors was not stated. 

The VCS does appear to have- definite predictive value. Since 
criteria both. within sheltered facilities and communities vary, It Is 
recorpmended by the author's that separate norms be established for each 
user. 

Cobb, In calling attention to the fact that several of the scales' 
used In the VCS are measures of functions subject to developmental and 
learning changes, suggests that Its predictive value may well be much „ - 
.greater for short run than long run determinations*^ 

Further study, of course, would be In order. A significant start- 
ing point would be the work by C.J. Ho2 and the subsequent revision of 
the VCS. The revision of this scale was announced by MacDonald In 
;August of 1972 with the promise that a complete manual would follow.^ 
The revised scale eliminated the Physical Capacity, General Health, and^ 
Disc Assembly, and experimentally replaced them with the Crawford 
Dexterity Test, Pictorial Interest Test and a Motivation Test devised 
by the staff psychologist. QuartI le Scores were retained but revised 
weights were assigned to the components. 

MCCARRON - DIAL WORK EVALUATION SYSTEM 
-Lawrence T. McCarron i Jack G. Dial 
-Available from: Indl^'^a State University Bookstore 
Terre aute, Indiana 47809 

A test battery still In the process of Initial release Is the 
McCarron-DIal Work Evaluation System devised by Lawrence T. McCarron, 
Department of Psychology, I ndlana -State University, and Jack G. Dial, 
Beaumont St^te Center for Human Development. The manual for the system 
Is not yet available although rough drafts of chapters one and two. were 
received for review. A limited number of kits containing the materials 
Involved are available at $350. 



^Henry V. Cobb, The Forecast of Fulfillment , op, cit. p. 85 
^C.J . Ho, op. cIt. 

^^^acDonald Training Center, "Revision of the Vocational Capacity 
Scale" (MacDonald Training Center, Tampa, Florida 1972). 
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According to the authors the MDWES attempts to estimate two 
criteria: ^'generaf vocational competoncy, arvd specific task produc- 
tivity/* This Is done by assessing five ^'predictive factors" through 
the use of both standard and specially contrived tests. The "Vdrbal- 
coqnltlve" factor*" Is assessed through the use of the Wechsler Adult 
Intel Iglence Scale or the Stanford-Blnet Intelligence Scale and the 
Peabody Picture Vocabu lary Jest. The ''Senspry" factor Is gathered from 
the Bender Visual Motor Gestalt Test and the Haptic Visual Discrimina- 
tion Test. "Motor" ability Is reflected by the ''McCarron Assessment 
of Neuromuscular Development: Fine arid Gross Motor Abilities" a battery 
of ten tasks, five assessing fine motor and five assessing gross motor 
skills. "Emotlonar* evaluation Is taken from the "Observational 
Emotional Inventory" (McCarron and Dial, 1973) "on observational 
Instrument to be used by work evaluators and supervisors In community 
sheltered workshops", according to the authors. The Inventory attempts 
•to assess ''Neuropsychologlcal-Impulslvlty, Anxiety, Depression-Withdrawal, 
Socialization, and Se I f -concept*' . 

"lntegr?itIon and Coolnq" which appears to refer' to the client's 
ability to function successfully In a work setting,^ Is measured through 
th^ San Francisco Vocational Competence Scale and .a Behavioral Rating 
Scale developed by Dial (1973). ^ 

Multiple regression formulas are used to predict work performance 
(.equating the product of the formula to the scoring tables of the SFVCS) 
and work productivity (equated to the sample work task known as the 
"Fishing Tackle Assembly Task") . ^ These formulas have been devised for 
abbreviated lists of predictors as well as the full battery and data 
are also cited for periods beyond one vear post testing. 

If the McCarron Dial System fulfills the claims of It's authors. 
It will Indeed 'be a major contribution to the field of predictive voca- 
tional evaluation of all retarded. 

Materials Development Center In rev lew I no the McCarron Dial System' 
calls attention to three weaknesses. First, all these. tests must be 
Individual ly administered, several by a trained psychologist. This Is 
particularly unfortunate In that trained psychologists are not always 
easily accessible to work evaluation units. Second, althouph the 
authors state that performance and productivity scores reflect the 
Individual's level of programming (day care, work activities, extended 
sheltered employment, transitional sheltered workshop employment and 
cofmiunlty enployment) MDC notes that there are no placing cutoffs or 
guidelines. Hopefully, this matter wlll-be clarified when chapter three 
of the MDWES manual Is made available. Chapter three Is said to contain 
a complete discussion of the vocational functioning levels. 



^Materials Development Center, slide-tape review of the f^cCarron- 
Dlal-Work Evaluation System, (Materials Development Center, University 
of Wisconsin - Stout", Mpnomonle, WUcon<;In). 
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0 Third, Material Development complains that the research 
methodology Is not clearly explained* The material received from 
the authors does not contain any data pertaining to the test popula- 
tions used for norming purposes nor does It appear from the table of 
contents for the manual that a full report on this will be forthcoming. 

At the very least the^cCarron-Dlal System must be viewed with 
some Interest. Whether or not validation studle§^wlll reveal that It 
Is Indeed capable of fulfilling the goals set forth by the authors, 
must remain to be seen. 



\ 
\ 
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im"EREST TESTING 



A number of studies on vocational placement of the retarded 
Include a follow-up analysis of reasons for Job failures, . In nx)st 
cases, provided that appropriate placement procedures have been used, 
the clients apparently were able to meet the skill and strength demands 
of the Job. The majorltyof f^Jlures appeared, to reflect difficulties 
\pertalnlng to work Interests, habits, motlva'" *on tand understanding of 
job requirements (Abel, 1940; MIchael-Smlth, 11.0; Marfzler, 1951; 
C^hen, 1960; WIndle, 1961) J For this reason, there has been steadily 
Increasing concern shown In the 'area of vocational Interest evaluation 
of tne retarded. 

\ ' ■ 

. Th'e use of Interest testing #/lth the TMRi has lagged behind for 
many of ^the same reasons as have other areas of vocational evaluation 
for the ff^. First, of course, until very recently, the TMR was not 
seriously considered for employment In a competitive or even sheltered 
situation* He was placed on the lowest level task available In the 
•facility and any problcSifis of work attitude or behavior were assumed to 
verify his unemployabi I Ity, 

Second, consideration .must be given to the question of the effect 
of. the TMR's lack of vocational exposure and retarded social maturity 
upon his vocational Interests. If he has the aptitude for differential^ 
Job placement, does he have enough exposure to Job differences from 
which he can express ^choice? 

Third, few Interest measures have existed which conta-Ined a 
significant number of occupations which could be seen as realistic 
goals for a TMR population. > 

With the Increased Interest In this population, however, some work 
has been done In the field. In an effort to assess the validity of 
occupational choices among various levels of MR populations, Cohen and 
Rusalem conducted a study utilizing thr^e student populations: "normar* 
"non-lnstftutlonal Ized retardates" and ''Institutionalized retardates",2 



IParnlcky i Kahn, op. cit. 

2cohen and Rusalem, "Occupational Values of Retarded Students" 
American Journal of Mental Deficiency, July 1964, no. !54-.^1. 
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Characteristics of the t«st population are charted below. Note 
that the institutionalized population has a mean IQ less than one 
standard deviation above the Tf^ range. The study Is therefore Jticluded 
as giving some Indication, at least In that segment, of the performance 
of a TMR population. 





Institutional (1) 
Mean SD 


Non- Institutional 42) 
Mean SD 


Normal 
Mean 


(3) 
SD 


AGE 
Boys 
Girls 
Total 


.19.0 

rs.i 

18.7 


1.9 
1.9 
1.9 


17.9 
17.9 
17.9 


0.9 
0.9 
0.9 


18.3 
18.0 
18.1 


0.9 
0.6 
0.7 


FULtMO 
Boys 
Girls 
Total 


62.1 
60.1 
61.7 


14.9 
9.9 
13.6 


68.7 
74.8 
71.2 


12.8 
12.5 • 
12.9 


97.1 
101.5' 
99.6 


21 iO 
15.9 
19.3 



(1) Eighty-five secondary school age'stu^dents attending 

■ the' Edward R. Johnstone Training and Research Center, 
Bordertfown, New Jersey. (It should be noted that 
clients are transferred to this Institution from other 
Institutions within the state because they demonstrate, 
promise of benefiting from a specialized Institutional 
rehabilitation progral^ designed to reiturn them to the 
community. .Therefore, It Is not a random population.) 

(2) Ninety-two secolidary school age students attending 
special classes for the mentally retarded maintained by 
the Trentdn, N.J. public school system. Method of 
selection of this group was not noted. 

(3) Ninety-nine secondary school students attending regular 
classes In the Trenton community. 



Students were presented with nine occupational- values: advancement, 
benefits. Independence, Interest log., work, pkpestlge, relations with 
others, salary, security, and working conditions. Each value was 
accompanied by a brief explanation keyed to the vocabulary and compre- 
hension level of the two retarded groups. (The values were presented 
orally to the two retarded groups and In written form to the normal 
group.) The order of presentation of value choices' was varied randomly. 
Each retarded student was asked to Identify the most Important occupa- 
tional value. It was tKen marked and the list read again omitting 
this Item. This proctjure was followed until all Items were ranked. 
(Possible greater validity wouId*bave been obtained with retarded 
populations by subdividing the nine Into smaller groups. -Being faced 
with the necessity of making choice from lists of seven, eight, or 
nine Items could be expected to cause confusion and almost random choice 
responses from many MR's.) 

The mean ranks for the nine Items were computed both for the three 
major groups and for sub-groups of boys and girls. Based upon the mean 
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rankings, the nine values then were ranKed from one to nine 
hfghest ranked Item being assigned first rank. Rank order 
between the groups were obtained and tested . for, statist ica 
Results are flstod below, ^, 

BOYS 



/•Vfth the 
correlations 
signlf Icance, 



OCCUPATIONAL VALUE RANKINGS 

Non-Instltu- 
tlonallzed 



Institu- 
tionalized 



"A chance to get ahead'* 
''Job I can. enjoy" 
''Steady work; sure of a Job" 
"Vacations, SS, Retlr^ement" 
"Good hpurs; pleasant surrour 
"Highly paid Job" 
"Work with people I like" 
-"Job highly respected" 
"Be my owh^ boss" 



Norma 1 


Retarded 


Retarded 


1 


r.5" . . 


4. 5 


2 • 


7 • 


- "4.^ » 


3"' . 


4 


. 3 


4 


1.5 


1 ■ 


" 5 


3 




6 


/ \, 8 - 




7 


5 




8 


6 




9 


• 9 


9 



OCCUPATIONAL VALUE RANKINGS - GIRLS 



"A chance to get ahe?d" 
"Job I can enjoy" 
"Steady work; sure of a Job*' 
"Vacatlona, SS, Retirement" 
"Good hours; pleasant surroundings" 
"Highly paid Job" ' 
"Work with people I like" 
"Job highly respected" 
"Be my own boss" 



Statistical significance of the results Is as follows: 





Non-In'stltu- 


fnstltu- 




tlona 1 1 zed 


.tlonal 


Norma 1 


Retarded 


Retarded 


2 • 


4 


3 ' 


1 


2 


• 1 . 


3 


5 


4 


7 


7 


7 


4 


i 


5 


6 


8 


6 


. 5 


3 


t 


8 


6 


8 


9 


9 


9 


a 







RANK ORDER CORRELATIONS AWNG RANKINGS 
'XCUPATIOMAL VALUES BY SUBl-GROUPS 



Males 

Institutionalized retardates vs* non- 

Institutionalized retardates 
Institutionalized retardates vs. normals 
Non- Institutional I zed retardates vs. normals 
Females * 

Institutionalized retardates vs. non- 

InstI tutlonal Fzed retardates 
Institutionalized retardates vs. normals 
-Non- Institutional I zed retardates vs. normals 



Significance at 
Rho the 5i Level 



.70 P<.a5> 
.51 N.S, 
.60 N.S- 



.75 P<.05 
.83 P<.05 
.77 P<.05 
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Males. vs> Females 
Institutionalized Retardates 
Non-Instltutlonal Ized Retardates 
Normals 



• Significance at 

.Rho the 5% Level 

.56 >n;s. , 

.41 N,S, ) 

.87 P<,05 ',^ • 



The authors note with Interest that there appears to be greater 
resemblance between ^ub-groups of girls wlthlp the study ^than between ^ 
the sub-group of boys* "All groups consistently assigned Ibw ranks .to 
Independence, prestige and salary* 6oth sexes placed high value on 
advancement suggesting that despite Intellectual capacl'ty, most of these^ 
students had expectations of- achieving high-level vocatldnal objectives*" 
The authors suggest that the greater similarities tmfjte^n girl sub- 
groups may reflect greater similarities In percelvedyrole tetween girls 
of various Intellectual levels, "Conse(|^uent I y, .vocational counse.ling 
of retarded girls may fupct(|9n,on the assumption that these glHs are 
seeking similar values from their work as non-retaWed gl.rl.s-*" On the 
other hand, counseling with retaVded boys* should be based on' thd- assump- 
tion that this population places greater emphasis on Job benefits and 
less upon relations with others nd Interesting work* "There Us sofne 
"reason to believe that retarded boys find It difficult to postpone- 
"satisfaction and need. In. their work. Immediate or early gratification," 

Lacking In the study Is any type of analysis reflecting the degree 
of unanimity within each sub-group. Sub-group means obtain significance 
•only If there Is significant agreement *wl thin the group. This has great 
Importance when dealing with factors such as verbal explanations, where 
there l^s a great possibility of a lack of understanding. Without a 
measure of this type there I? no Indication that the test Is^^actqally a 
valid measurement of the attributes te'sted. 

Whether or not the cholcea reflect legitimate, cqnslstent 
Interests has yet to be estabi Ished. Particularly Important' would 'be 
similar stud I es. of 'older age groups to find. If interests expressed at 
the younger age level remain -constant, even among normal populations. 
On the surface, at least to the authors df^Thls artlcle^Hhe choices 
made by the testees appear to have vafldl.ty. 

In 1965 BlUle W. Burr; and Albert'M. Barrett adapted- an e>^lstlng 
Interest test so that It required no reading.^ 

The authors* found |r Interest testing of retardates, especially . 
within the moderate ranae, that (1) tests requiring even a minimum, of 
reading ability were unrealistic, and (2) that even I ;i -picture tests, 
response wps* frequent ly to specific Items within the picture rather 
than to the occupation which It Illustrated* . % 



^Burg and Barrett, "Interest Testing with the- Mentally Retarded - 
*A 31-sensory Approach"", Anerlcan Journal of Mental Def Icioncy , 'Vol . 6^, 
^k). 4. pp. 548-553. * - V 
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In an effort to counteract this, the authors devlslpd a set of 
verbal descriptions to accompany a standard Interest test which was 
primarily pictorial with a minimum of verbal questioning. The test 
used was the Gelst Picture Interest Inventory (GPII). I|n some cases 
the titles which Geist used were utilized, In other cases simplifica- 
tions which were more descriptive were substituted, 

\ Fol lowing Is Identification of the drawings on the GPI 1 for males 
as devised bf the authors: 



TABLE I 



\ 



\ 



Identifications of Drawings In the GPII 



ERLC 



Booklet 
Page 



Pictures 
2 



1 

1 • 


*?r lent! st 


Worker on trees 


2 


Actor* 


Eng 1 i sh teacher 




Worker at blast 


Arithmetic teacher 




1 U i 1 iO\^\J 




4. 


Jar maker 


Mus Id an 


^ • 


Wor"l<Ar" npiininn 
nsjt t\\jt iJ* uii 1 iiu a 


Dentist* 




+PAA 
1 1 X3XJ 




6. 


Doctor 


Welder* 


7. 


singer 


President of the 






United States* 


8. 


Musician* 


Scientist 


9. 


Violin* 


Plants 


10. 


Ruins of Greece 


Abstract art 


11. 


Jet pi lots and 


Things left by 




Diane ^ 


people long ago 


12. 


House^where they 


Job counsel ing 




study the \sun 




13. 


Mus i ca 1 I n^truments 


What a druggist uses 


14. 


Woodwork* .\ 


Throwing your voice 


15. 


Music 


Acting 


16. 


Grocery store* 


Corn field 


17. 


Pol iticlan* 


Clothing sales 






per«;on 


18. 


Newspaper man 


Musician* 


19. 


Person who draws 


Jewel ry sa les 




houses 


person 


20. 


Actinq 


Drawing clothes 


21. 


Speaker 


Musician 


22. 


Person who hires 


Airport ticket 




' peop I e ^ 


taker* 


23, 


Air Force wlnqs 


Graduation diploma 


24f, 


Art* 


Dramatics 
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Musician 



Person who looks 
at the start 



Rad io announcer 
Music conductor 
Business person 

Doctor 

Man a'ddinq on a machine 



Man who draws roads 
Basebai I .player* 



Librarian 

Arithmetic 

Man tra Ining dog 

Settlement worker* 



Track 



Pen and penci I set 
Photography* 
Art* ^ 

Paper mill* 

Barber or beautician 



Pol Iceman 
Animal doctor 



Scout leader 

Mai I man 

Car salesman 



Movie Oscar 
Business* 
Siqn oa Inter 



? 
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26. Telephone lineman 

27 • Scientist* 

28. Grocery clerk* 

29. Salesman* 

30. f^aglclan 

31. Lawyer* 

32. Playground director 

33. Statue 

34. Minister or priest 

35. George Washington 
crossing the Delaware 

36. Blacksmith* 

37. FI I Ing cabinet* 

38. Modern dancinq 

39. Ballet dancer* 

40. , Adding machine 
"4^ ,.. Actor 

42. ^ Drav^hotjses 

43. Movie directing* 

44. Examine eyes 



Judge 
Typist* 
Fisherman* 
Farmer 

Person who writes 
stories 
Machinist* 
Asking questions 
about fami I les 
Chart made with 
arithmetic ^ 
AppI lance salesman 
DrI 1 1 press* 

Shoe salesman* 
Things used to 
draw plans ^ 
Hardware salesman 
Statistician* 
Saw* 

Scientist 
Puppetry* 

Jonah and the Whale 
Adding machine " 



Musician • 

House decorator 

Druggist 

Bank teller* 

Person who draws 

funny papers ^ 

Social science teacher 

Making designs on 

leather 

Songs* 

Bus Iness man* 
Weather map 

Student* 
Paint set 

Motion picture actor* 

Choir singer* 

Books* 

Musician* 

Dancing* 

Car engine ^ 
Insurance salesman 



*GeIst's original Identifications. 

When Burg and BaWett»s work was done/ (1961) the Gelst was 
available only for males. Research Into the Gelst test for females 
would, of course, be equally appropriate. 

It was fdijnd that\ the ;test could be administered to groups of five 
clients at one time by havjng tl^ seated In roughly the shape of a 
pentagon, all facln^^out, with the administrator In the center. Each 
client rece'lvlnq the test Is asked to identify the object on the front 
of the test booklet In Arder to assess his visual acuity., His ability 
to make the necessary Idl^ntf-f Icatlons required regarding positions of 
pictures In the series Is^ (then assessed. 

During the test adm illustration, the examiner reads the questions 
on the page and descrlbes^each' picture. He then repeats the question. 
The client Is asked to Indicate his preference by raising the appro- 
priate number of fingers or pointing at his preference on the page* 

At the time of publication of the findings, the validity of the bl- 
sensory form of administration of the Gelst had not been established. 
Scores obtained from the retarded population were compared with Table 21 
In the Gelst manual which presents combined U.S. Mainland means and 
standard deviations together with those of the Hawaiian and Puerto 
RIcan samples. A direct comparison of these scores Indicated that the 
retarded sample obtained mean scores that exceeded the general copulation 
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In. the areas of mechanical, clerical, outdoor, social service and 
dramatic. The authors do not draw specific conclusions from these 
findings but leave open the questions as to whether these results 
reflect basic, valid, Interest patterns. They also suggest, especially 
In light of the fact that the sample was obtained from a single facil- 
ity, the possibility of contamination of the sample by Institutional 
training procedures. \ 

This study poses Interesting possibilities for further research. 
Would the results of this study (comparative means) be replicated In 
other programs? What about the Gelst for fomalos? Then, of course, 
the more general question of consistency, pertaining to all Interest 
testing of those who have- limited vocational exoosure, must be raised - 
not merely with this study but the whole field as previously discussed. 

There presently exist at-Jeast t^roe non-verbal Interest tests 
which could realistically bo a dmi ni^,tf; rr'(1 fo TMR populations. These 
are the Vocational Interest and Soohl stic.!JTion Asr>essnent (VISA), the 
Wide Range Interest and v^plnion Tos^ '^^M^T) /jnd the California 
Picture Interest Inventory (PI I). An --'fort hao also been made to 
adapt the Gelst Picture Interest Irvf-ntory C^PII) for administration 
to this population as mentioned ei=>rlipr. 



VOCATIONAL I rfTEREST AND SOPHISTICATION ASSESSMENT 
-Parnlcky f Kahn 

-Present availability unknown. Developed at; 
Edward Johnstone Training A Research Center 
Bordontown, N.J. 08595 

The Vocational Interest and Sophistication Assessment, originating 
as a part of the Johnstone Project described by Parnlcky and Kahn 
(1963)1, Is Included here desoite the f^ct tnat It was designed for an 
EMR population. The VISA present<^ sovural unique features of design 
that would allow it to be adapted for use with ■^»'>e riR population. 

The Interhst Dortion of th-r original test consisted of\^ number of 
line drawings showlnn rooole workln^q at various jobs usually considered 
ns suitable for the retarded (although this assumotlon Itself dould be 
open to question). The ^rn\/inqs show males Involved In the fleld^of 
construct I on-m^!n+enanco, f arm- -jrbunJr. , food service, garage, Indus+rlal 
3nd laundry. For fonalt-s tho cf.oices are bu«;ln.->'-,f;-clerlcal , food 
service*; ^ousoke<-'^inn, indu'> trial and liundry. 

In tbi"^ •^ri<:|r;-^| ^.-^.rn^ care w.'^c; •r-'kofi to rhow the diff'^rfjp"^ job 
,=5re->'i -i ' ^ f r'"»nt "^»r' In'^ onnH t i^^n'-.i o.'^. th-- presence or absence 

oth^r v;or»''<'*'"0 : ■**'*.^ :^r-^ ;n..-e or "^^vence of '"j uperv i S ion . 
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JoJl^w-up studies of the original form Indicated that these varying 
conditions appeared to have no discriminative bearing upon the choices. 

The client Is shown each drawing and asked I f he wou I d I I ke to 
perform the work shown "a lot'\ "a llttle'\ or '^npt at all/* The test . 
administrator Is warned to be> watchful for response set and make every 
effort to counteract It. In this type of testing, clients apparently^ 
do have a tendency to consistently qlve the same response to all 
questions. Therefore, a forced choice format would offer certain 
advantages even though response set is still possible* 

Tne "Sophistication" portion of the VISA consists of a series of 
questions which are asked oof ore the Interest portion of the test Is 
presented. The questions aro asked about pictures +aken from the 
"Interest" portion and assess the subject's knowlecge of the Jobs which 
are illustrated. "How nucn would a person make for doing the Job/' 
**What do you call a persoi who does this kind of work/' "What other 
things would he have to do." The premise which appears to be operating 
here. Is that for an Individual's Interests to have high validity the 
Interests should reflect knowledqe of the Job area. Unless there has 
been a recent revision of the Information used on the sophistication 
scale, however (the scale was designed In the early 1960's), It reflects 
a grossly unrealistic concept of pay received In certain Job areas. It 
was noted in the report that an additional VRA grant had J)een applied 
for In 1963 (VRA Project 1221) In order to further deverol)'the VISA. 
Results of this project are unknown. The scale presents an Interesting 
approach In several ways. 

1. It shows appropriate Jobs In simple, line drawings. 

2. It attempts to deal with the question of sophistication which, 
as yet, Is a largely unknown variable. 

3. It Is administered orally and only simple responses are 
called for - client does not have to make choices between 
pictures. 

The problems are as follow: and here again It must be stressed 
that only limited Information was available plus what appeared to b3 an 
experimental version of "the test. 

1 . There Is a lack of data on rel labl I Ity and val Idlty. 

2. The simple response format mentioned above presenl^i a 
disadvantage. Many clients, seeking to give expected or 
acceptable responses, will say they like to do everything 
and not discriminate be+ween Jobs - a problem avo4ded In 
forced choice situations. 

3. Some of the drawings are ambiguous both In regard to what 
the client Is doing and which of the cersons pictured the 
client Is expected to relate to. 

4. The soph I sticafldrr el^ement Is largely an unknown. If valid. 
It would require constant updatlr.q to stay abreast of changes 
In the minimum wage law, etc. .Jndeed the effect of sophis- 
tication uDon validity of choices \^ still not proven. 
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5. The question must be raised as to whether the test is 
excessively Minlting In view of the small number of 
fields which are Illustrated. 

WIDE RANGE JNTEREST-OPINION TEST (WRIOT) 
-J.F. Jastak and S.R. Jastak 
-Available from: 1526 Gilpin Avenue'' 
Wilmington, Delaware 

The WRIOT is a recently published picture Interest test composed 
of 150 sets of three pictures each. The client Is asked to record the 
pictures liked ''most'* and "least'* In each set. Pictures contain both 
male and female figures and separate scoring guides are used for each 
sex. No reading Is required on the part of the client and the responses 
can be recorded by either the client or the testor. The test was normed 
on a population of 951 which the authors say was representative of the 
genera) population. Norms were also drawn using tenth and eleventh 
grade high school students. Approprlatenees of the test population Is 
open to question because at least the adult population contained a high 
-percentage, of rehabilitation clients.^ No norms are available for 
retarded populations but additional norms are promised in the near 
future. Test reliability is based on split-half coefficients using 
Cureton's formula and aooearsadequate. 

Results are given as "T*' scores In eighteen Job cluster and 
Interest areas Including: Art, Drama, Sales, Management, Social Service, 
Number, Mechanics, Outdoor* Other scores are also given: Sedentariness, 
Risk, Ambition, Chosen Skill Level, Activity by Sex, Agreement (a. mea- 
sure of validity), and Interest Spr^ad^^ I nterpretatlon of significant 
scores is covered In the manual. 

T^^ clients occasionally require oral administration of the test 
with the testor recording scores. The test^ is rather long, especially 
for those with limited attention span. Valid test results *^ave been 
obtained with TMR groups, however. Although additional research Is 
needed to validate the test, it appears to be one of the more promising 
available Interest tests at this point. 



PICTURE INTEREST INVENTORY (PI I) 
-Kurt P. V/cingarten . . 

-Available from: California Test' Bureau/McGraw Hill 
Del Monte Research Park 
Monterey, Calfforrila 93940 

The ^11 is cornposed of two parts, ^art one contains ^ifty-three 
groups of three-picture-sets, from which each client Is asked to pick 



^Jc-j^tak and J.ist^k, WRIOT '\iw j3 \ , (^ulloncc A<5SO'^Iates of 
Dclowar.?, -/il'Mnitcn. 1972) p. 9 



the one ho likes nost and the one he lIKes least. Part two contains 
thirty illustrations ?.r\d the^exaaW nee is morcry asked to state whether 
he likes or dislikes eaefv^tX^ reading Is required and the test may be 
adniniGtorod orally. 

Although the test is non-verbal, there is alrnost a conpi.ete jack of 
representation of those job areas where illiterates can perform satis- 
factorily. With the exception of qroundskeeping there are no pictures 
related to janitorial tasks, and none which would bo identified as 
routine factory work. 

This test apDirontly has not Doen revised since its Initial release 
{1938) and as a rosjlt so^i^ of the oictur^s used ore berjinninq to apoear 
dated. This Is mostly apparent in the nroos used In the pictures, the 
dress of the figures,, and the Lack of pictures applicable to some 
current fields. Also, although the tost can be used for both sexes, 
all pictures are of nale f inures. This nay prove confusinn and'disturb- 
inq to female exanlnees.^ 

The tests were norned on 1000 junior and senior hl^h school 
students In sixteen st=»tos. Mo data was included to verify whether or 
not this was a reprosentat 1 ve sonole of the total hi oh school popula- 
tion and no adult oooulatlons wore used. 

Answers are comouted Intends of percentiles on six "Fields of 
Interest' scales* I nterocrsona I , Natural, Mechanical, Business, 
Esthetic and Sclr^ntlf Ic. There are also three supplementary scales: 
Verbal, Computational, and Time f^crsoectl ve (Interest In lobs requiring 
a period of tfrno or tralninq fpr the attainment of proficiency). 
Although the manual contains correlations between the scales and 
scores for Individual occupations, the tester usually must make his 
vocational decisions based upon the 'general scales. ^ ^ 



^KPir\ ^. ^r'tter^jsch , XfLlt.*LJLniL-i^I^A^X^^^ 
Evaluators, (Ma+erlols Oevt» loo^.ent Cento^, *'^nomonIe, Wisconsin 1^73) 
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In the course of the survey, information frequnntly cones to light 
which is not directly related to the subject at hand but which would 
still provide useful information for those interested in the field. 
The following are four such articles which are not specifically about 
prediction of enployabi I i ty. Thoy would; however, be of value and 
interest to anyone involved in vocational evaluation of the P1R. 

* The\ first study is by Lloyd ''oadow and Eugene Greenspan (1961) at 
the. Jewish Vocational ^>ervice and thv!) 'Comnuni ty V/orkshop In cooperation 
with the Detroit Association for f^etardod Children J The test popula- 
tion was, identi f led as being composed of younq adults of *'worki ng* age" 
(19-31) with lO's ranqinq fron 47 to 60 with a Meaft) of 53. The test , 
poDulatlon was extremely small (M=10) and was atypical in the sense 'that \ 
It was conposod of young adults who were consi'dered nost feasible for a 
rehabilitation program although none had a previous work experience. 

The purposo of the study was to test the effect of work exposure. 
In this cas«9i sub-contract work In a sheltered shoo, upon the functioning 
level of a retarded population. 

the clients were first given a battery of tests Including psycho- 
logical and dexter'itv tosts (WISC. MRMT, O'Connor Finger and Tweezer 
Tests, WRAT spelling, reading and arithmetic). Work behaviors during 
testing were also noted. Clients were then placed In the workshop on 
a variety of sub-contracts including hand assembly, light packaging, 
mailing, and salvage. There was frequent Interaction with Workshop 
counselors and the client was given more difficult jobs as his feelings 
about (VOrk becane more Secure. ^ ' 

Ut)On completion of a three month period the sano battery of tests 
was repeated. Although there was a possibility of practice effect the 
results of the 10 test were unchanged. There was a slight improvement 
'In the Minnesota agd O'Connor tosts (statistical significance not stated) 
but the scores remained well below those of the general population. The 
authors also stated that thore was Tittle change In basic personality 
and sighted a parallel with the studv by Nef f at the Jewish Vocational 
Service of Chicago. 



1 Lloyd Moadow and Eugene Greenspan, ''Emoloyabl 1 1 ty of Lower Level 
Mental Retardates'". Amor i can JournaJ^ jof_Ment^^^ Vol. 65, 5. 

(March 1961) pp. 623-6:^1. 
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The generalized conclusions of the study as stated by the authors 
are as follow. The work perforned anpoared to be more meaningful to 
them than their ^-revlous social and recreational activities. Most of 
the retardates were extremely proud of their regul-ar pay checks. The 
amounts they received did not 'jeen as Important as the fact^that they 
were worklnq for pay,,,, Knowlodqe that they were working on real Jobs 
similar to those done In private Industry appeared to be an Important 
motivating factor," 

At tho conclusion of the study two of the ten clients were, donsl d- 
ercd unsuitable for any kind of employment. Five of the clients made 
sufficient oro-jress to be conslderod adequate for placement In a 
permanent sheltf=>red worksfiop. The remalnlnq three clients made the 
best adjustment and were thought to have eono chance of adjusting to a 
regular Job under Ideal conditions. 

The conclusions of the study are aooarently based on observational 
assessment anJ would, of course, be subject to the subjective factors 
influenclm such assessments. 

If a general I zat ion of. the findings wero to be made, despite the 
small test sample and the aoai^auous assessment methods, It would be 
that apoarently workshop exposure makes significant Imorovement In work 
attitudes and behaviors but has minimum effects unon basic functioning 
as measured by dexterity, 10 or personality tests. These results 
duplicate In general the findings of Shu I man' with an EMR pooulatlon of 
somewhat larger size. In this studv, scores on the WISC, Purdue, Vine- 
land, Production (day-to-day and week avoraaos as oercentages of 
expected adult outout), and Self-Concept (based on Guthrie, 196rf2) 
remained stable on or -^^rar the estimated reliability of the Instruments. ; 
Work Ratings (diagnostic scale reflecting work-relevant behavior) did* 
not reflect this stahil-ity, ^rom year one of the project" to year three 
the stability coefficient was only> .36, Shulman feels this merely 
means that work ratings aro Dore a function of .learning and adaotatlon 
l^than of maturation. The .3^ may also lndlj:ate Inherent weaknesses of 
the scale. That is, the Individuals really didn't change - the test 
simply-has ooor reliability as an Instrument. 

A study related In a number of ways to the oreceedlng one was done 
by Jack Tobias and JacK Gorolick.-' The oroblems selected for 



' Lee S , Shulman, Th e Vocat ional Oe velopm en t of ftentally Handicapped 
A dolescents. An experimental and Longitudin al Study, (Educational 
Publication Services, Michlqan State University, E, Lanslno, Michigan, 
1967), 

26, M. Guthrie, Patterns of self-attitudes of retardates", 
A merican Journa I of ^^entaj De f Icie ncy^^^January, 1961 ) , 

^Jack Tobias and Jack Corel Ick, '*Work Characteristics of Retarded 
Aduits at Trainable Levels', on, cit, po,' 338-344. 
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Investigation In this study were as follow: (1) The relationship of 
productivity to IQ within the restricted range of the Day Center populh- 
tlon, (2) The effect of continued practice on productivity, (3) The 
effect of deferred monetary Incentives on production rates, (4) The- 
effect of fatigue on productivity. This factor was also considered to 
be a measure of 'work tolerance'- (5) The effect on productivity of a 
long InterruDtlon of tho task (a measure of retention)- (6) An examina- 
tion of the characteristics of identifiable trainees for whom even 
limited production activities were unsuitable- (7) An examination of 
production records of a Ntangolold group with an Intellectually equated 
non-f-tongolold group - 

f?opulatlon for the study was the entire client body (N=60) of the 
Occupation Day Center In Mew York- It was in many ways a specialized 
population because It was composed of those Judged "unsuitable for voca- 
tional rehabilitation" (terms In quotation marks are those of the 
authors but no^exp lanatlcn Is given of the origin or detgrmi nation of 
the unsultabi I Ity) . 10 of the population ranged from fifteen to fifty- 
two with a Moan of 33-8- In age they ranged from 18 to 34 with a Mean 
of 24-16- 

The procedure was as follows: Clients were trained In the dis- 
assembly of a nut, bolt -and washer which were then placed In separate 
trays- 'After the task had been learned the clients were seated In 
groups of six and the following work schedule was followed (only one 
session was held on a given (fay): ' 

Session I: Two hours of work 
SessloQ,JI: Two hours of "work 

Session IN: Announcement of payment for work followed 

by two hours of work- 
Session IV: Two hours of work, lunch, and two more hours 

of work- They were also reminded of payment 

based on productivity. 

An Interval of one month passed and then followed: 

Session V: Two hours of work 
Session VI: Two hours of work 

Results from the sessions were noted for three separate sub-groups. 

Group 1 whose IQ's ranged from 40 to 50. 

Group 2 whose 10* s ranged from 30 to 39. 

Group 3 whose IQ's ranged from 20 to 29. 

The relationship between the average hourly production for the three 

groups Is as follows: ^ ^ ^ 

Average Hourly Standard 

p Product I on Dev I at I on 

Group I 358-9 00.5 

GroupJI 250-1 78.7 

Group I I I 161-7 78-1 
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SlonI f lC'"5nco of diffnrpnco hf^^twe^'n noon«;: 

3etv/«-*^on Orour I ^-d Orour II +",^"^ Si'inif Iccinco: .'^Ol 
Hotv/een ^'Poun II th'J nrouo 111 +r»24 S^^nif icnnco: ,'^') 

Althourjii it would have h^H^^''] conr>l'Jornhly i^roc'uction scorer, of^^ 
hlqhor level retardate nroun^^'^a'^d non-hantjicawc i poouMtions boon ^ 
available for comparison, this study doe*; aopear +o In^llcato a roMtion- 
shlp between Int^lMnonco test scorns nnd th"^ nunbor ot uait-S orodiicod 
per hour. i ntor^'Stin-ily , ^irc.ups or>p and tv,'0 roachr-d .no,?k production • 
durln-;] the fifth session, th^it which ^r^nodiatnlv follov/«^d +ho one nonth 
layoff, .while nrou'^ three reached its "^eak Jurlnq sessior) four. Only 
group three show^j z\ {•^cro^so in rroducti<7n f<{>llow|nn th.> one month laV- 
off . Increases In orocluctlon /rom th^* ^-e'"lnnip^ to >ho end of the 
project w^re not considered si']nlficont -ind c^uld have been the result 
of chance. In other words, thero is aqain no sicnlflcanr Increase com- 
Inq as the result of oractice ^r l^^-irnln'-. 

Therp wa<^ a sHqht increase in thn first h^-^ur iftcr thp announce- 
ment was made re-^ardlnn payment, but ttns v/.?s not "n j r-ta I ncd . 

In- the third ^nJ fourth hours of production oji a s^n-:»o dny 
(session four), groua one showed an i ns Ion i f i cant Inor^^s*^ ^ro.jo two 
a slight decrease and oroup three .a pcre pronounced rir^crease, Apoarently 
fatlque and boredom apoear most slonlf leant at the lowest en:* of the 10 
ranne sampled In this studv and are Ipsiqnl f icant at the ton of th^ 
range. 

Although thev r^^ma I nedfc^t the work tables throughout the study, 
six of the subjects failed to learn the task and wore non-productive 
throuqhout. These six had I'^'s rannino fron fifteen to twenty.' This 
resulted In soeculatlon by the authors that tv.'^ntv. or a mental aqe of 
throe, ri^ht benln to constitute a border below which productive 
activity becomes unrealistic. 

Fifteen of the te<;t subjects were diagnosed as Monnoloid. V/hen 
they were matched with fifteen other clients of similar |0 .'=)nd ane, 
their hourly production ratt^s w^re found to be significantly lower* 

.''oncolold avera'^^' units ner hour 27*>.5 
?lon-*'onuo I oiJ avera^^e units p'^r hour 33''>.r! 
Difference between orouos ^7.7 
-siqnif icant at the .^I) level of confidence 

Much caution r-.jst lo exorcised In accentinci as genera I i ;:at ions 
the broad conclusions rfviched from this study. Lsoocially v;hen broken 
down Into subnrouos th*/ ne"'il^tIon n-jnbers Involv^^J in th^^ s'^ti ly are 
extremely small ^nd, of course, reflect only one population. Once 
a'jain the question rusi bo raised renardnie thp selection of the test 
population, ;.'ho ^^^ci^ed tnaf this croun was 'unsuiterj for vocatI<^naI 
rohab-i I i tatio'-^ ? 'ha^ v/oulJ have ue^^-n the results of the studv it 
.there n'»d been nr'rr s^^lrcfion yet +n<- s^.me |0 ranie w;j'. .'xaf.".! ned ? 
Did th'* •^•es"^ per 'i I ''tie- its^^lf f^t^t it was "unsu itr-H' } 



It would appior cipropriato fc^r 'additional studios 1o^oe made under 
sini'cir cond i t icrir, tr. verify or r\^futo t^a fir-roach i ncj conclusions 
posited ty th(: ui^rr". 

.A noro r;rnor3 1 i z*- : tnl^ rclatoJ sludy-wa^, coniuctod by DIstefano, 
Ellis and Slo<jn^ ir 1^^- in ,:r .^ff<^rt to dotor-lnc- the n^lationshlp 
between rotor prof Icit.^ncy :ind T.. M tt^^ough^ the if^telMgence statistics 
of the test populat ion aro (\\ven In terras of *-'nontal ane'\ conputatlons 
invclvirn the p( nt,^ I ^':c ^^f-nu dp'I t^ie chronolo%'Ica I ane moan would 
place the populatior v.ilMr: tho r-^r-c c f this p-irer Tseo belcw)^ 




^rA.^^ Qh ; 

— --Vp"'^,. " '-'oan f<ango \^ Mean 10 

Males (f.=.l^) ^.^^-11.^^0 ^.^"^O 9.r>6-2Q.O0 19.73 50 

Fenaies (-=^.^) ^.'s^-ir.P^ ^.K 11.4^-37.41 ??.2f- 41 

The test populatior i^> i^^ntified ns '^n.fr^lriy representative 
sample (tut actuni -^-.t^thods of dotofr^ininq the santpir- wore not identi- 
fied) of the rf-^'ldfotb ^^f 1h( Gt-stf Colony-iv<^c Training, School at ^ 
Plneville, Louisiar^a. Five rioter tests were Nadnj nlsterod: Lincoln- 
Oseretsky >^otor L evelopnent f.cale, ^a i I -Wa I k i r.- Te^.t, *linnosota Rgte of 
Manipulation Test, Hand-?+oad i ness Test, and Stronnth of Grip. These 
were adninistered in ^. single sc^sslor* but In varvlno order. All tests 
were adr^l n I stert^d bv the sane per«;on. 

The relaticn^^hips between the test I n^^+ru'^ents and mental age 
are as f o I low : 

C(>?^L LATir- jfTWLEiN TE::T IM^TPl^M[:^iT PF.rTOPNWiCC 
AND ViniAL Af'E 





ro'^a 1 e 


f'A Male 


LIncol n-C<;er' tskv 






Rai 1 -.'/al k i n*;^ 


.V 




'•'innosota PTacin-i 


.4^; 


.41 


^'innesota Turn In': 


.37 


.3r 


Hand-Stead i noss 


.Of 




Strenqth of '^rlp 


.7r^ 


.03 



The authors ere cautious In a^>cribinq far-reachinc slanificance to 
their s^udy sayinc: 'Perhaps the rest jnport^nt findinq is that intel- 
liqenco and motor proficiency as r-casured by these lests are positively 
related I nentally defective sut»jects whose CA is beyond that during' 
which rapid devclor^^^nt in rclor and intellectual abilities usually 
occurs. ' 



1*.Mchael K. J^istefano, Jr., 'cr-^an Til is, anr wi I ! Ian Sloan, 
Motor Proficiency in ^'ental "e^ecti ves", ^ercoptu^l and '*otor Skills , 
19S8, 9 "^p. ?31-r''4. 
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Discarded as an expranatloa of the correlations Iovolvlng>fte 
Minnesota Was the Rpsslblllty, sd^gested by ?>etts, that directions i 
were^ot corn^ehended. Since administration of the tests to a nunber . * . 
cf people In this range has revealed rc: eated difficulty wljh the 
Instructions, the temptation rernalns to Infer a relatl^s^lp despite ,i 
the feelJng of •the authors that there was none. 

Various tests for significance revealed that al'thouqh males wQRe 
more proflplent than females on all tests only the difference In rail- 
walking was statistically significant at .01.^ There was no slqnlfl^nt' 
difference py race and no sMnlflcant relationship between ^^^ental Age 
and Chronological Ago. This supoorts the findings of others that 
dexterity matures- at aoDroxImateR fourteen years. ^ ^ 

In many ways thc^ nost unique of the throe studies Is anoth^-^r study 
by Tobias an'd ^^orel Ick^, this time Involving a arpuo from the AHRC 
Training Center and Sheltered Workshop In New York. The st5.»dy concen- 
trates on the tendency of sore trainees to arrange and organize their 
completed work far beyond the reculrenents of the Job, frecuently taking 
excessive care to rnakr* neat plle3 and neo'^^etrlc arrancenonts even when 
such organization has r.o practical value. The authors undertook their 
study to provide answers to the followinq questions: 1. Is e>ccrsslvo 
orderliness a universal characteristic anonq retarded adults? 2, Is 
there a rel at lonstj I r between 'orderliness' and Intel I Iqencc? 3. When 
*order I I ness * Is denonstreted, does It have any sirinlf leant effect on 
productivity? 

The test Dcoulat-fon was connosed ,of sixty mentally retarded adults 
(IQ range 2f-75) who were trainees of the above named workshop. The ■ ' * 

population was accustomed to frequent changes of Job assignments. 

The task reqfilrod the assembly of four netal pieces to form a ' 
wlre-clamp. Following Injtlal Instruction each client was given a 
metal tray containing hthe necessary parts. Under condition "A'* the 
client was to put the completed paction the table In front of him with 
complete freedom to arrange the parts as he saw fit. Under condition 
'*3" each client was told to drop his finished oarts In cardboard con- 
tainers placed on the floor beside hl'^» thus r-l Ifr | nat I no the. temptation 
to handle them further. Each suLj.ect-^'iroceeded* through two trials under . ^ 
each condition In elthe^r of the followlna routines: A-B-A-B or 
B-A-i3-A.* Extent of patterning under condition '^A" was evaluated as ^ 
follows: (1) RMId Ordering: Th6 subject's compleTed work exhibited 
some definite geometric arrangement (I.e. stralaht lines or all oleces ^ 
facing same direction). (2) Vague Ordering: 'The existence of an 



Jg.M. Cantor and CM. St^cey, "Manipulative Dexterity in Montal ^ 
Defectives', ^nerican Journal of Mental Deficiency , 1951, pp. 401-410 

'^Jack Tobias and Jack lorelick, "An Investigation of 'Orderliness' 
as a Characteristic of Montahy ''etarded Adults", Afjferican Journal ;of 
Mental Def Iciency , Vol. '^•4. No. 4, pp. 761-7^. 
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unidentifiable or Inconsistent pattern but not a haphazard arrangenient. 
(3) Haphazard Arrangement: No tendency toward placing the work In any 
organized arrangement. 

Slightly less than half the Retarded adults In the Workshop mani- 
fested a definite tendency toward unnecessary 'organi zaf Ion and arrange- 
• ment (RIgIt Ordering).. An additional group was cited as^showlng the 
< same tendency but was ''unable to maintain It because of 'short attention 
' span and distractlbl I lty*\ It Is assumed thaf'tKls rationale for the' 
dlscontlnuatlon^of the order+ng Is based -on past experience w.lth the 
clients although other pr>(>tl vatlon (such as Increased Interest In produc- 
tion) also mlgh> have precipitated the same results. ThQ mean 10 for 
' the "Rigid Order I nq"' group wa"s found to be 51 and that of the ''Haphazard^' 
group w:is found to be 57 a figure statistically significant at the .02 
level of confidence. 10 figures were not Listed for the *'Vague Ordering" 
group. 

ft - * " • 

To determine If "Rigid Ordering" had an effect upon production the 
average hourly production of each of these Vralnees was compared under 
both conditions. No Information Is given to verify whether or not' 
sufficient control of other variables was kept at this point (such as * 
tjme of day of administration) to prevent contamination of the results. 

Average hourly production of the "f^Iqld Ordering*' ijroup under 
condition "A" was recorded as 97.27; average prt)ductlon under -condition . 
"S" was recorded as 107.67-; This would be statistically significant 
at better than the .9.1 level of ^conf Idence. The production: of the 

-.^ * ^ "Haphazard" group was also noted* under both- conditions/ The results 

were as follow: Condition "A": 112.02; Condition 'B'*; 113.04. The. 
difference Is statistically Insignificant but* suggests that condition 
"B" Is conducive to higher production Irregardless of other factors. 
The Increase Is definitely within the "chance" range statistically. 
V. . - - ' . . 

The authors summarize their results as follows" "Retarded 
. . adults who exhibit a rl-gid o'rderl lness#^n their work produce less than^ 
they are able. Thel r oroductlvlty rises- as external conditions prevent 
V this trait faon operating." Although the presence- of .orderl lne$s "Is , 
^evld^t at all levels of retardation, the tendency becomes less pro- 
VT /nounced as the scale of lO's rises." 'Tven vague or Inconsistent 
* orderll-ness has a detrimental effect on productivity." 

V >^V^The authors see ttfelr study as having practical' Inpl icatlons for 
^ workshop production, recommending that work/^hould be arranged In such 
way as to make spontaneous "ordering" Impossible. The ImpI leaf Ion 
for work evaluation ^u.ld be found In the Identification of this trait i 
In Individual clients and an- awareness of the Implications whicfi this ' 
would have In jobs where ordering would be possible. Yet to be / 
explored are the more far-roachlno auestlons as to whether or not ' 
"ordering" is an Indicator of other non-productive behaviors and [ 
attitudes or whether It functions Independently of other traits. 
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In the Introduction to this paper reference was made to the study 
by Delp^ carried on at the Training School - VIneland, NJ, --It' was 
the author's purpose to refute certain conceptions* concerning ^nec^ssary 
IQ levels fcr training or adequate ,f.unctJonIng In different areas/ To ^ 
accomplish this Mr. Delp conducted a survey o-f the rather extensive \ 
facilities of The Training School and found, that, those ^successf ul ^y*- 
carrylng out certain Jobs did have IQ's below that which was generally, 
considered minimal. It Is unlikely that the results can be accepted- 
at face valae.'- There would be every reason to suspect that ttie Job 
demands would be vastly dIffeVent between the Gompetltlve version- of a ■ 
Job and that conducted In the sheltered confines of Vine I and. Examples 
would-be difference^ In. supervl sor expectat lon^, Increased structure 
(absenteeism can be control Iqo' much mone directly tn an Institution), ^ 
actual simplification of Job demands, and the different atmosphere of 
Interpersonal relations between co-workers.* Therefore, the IQ required 
to perform a task under the sheltered conditions Mr. Delp was observing 
might Indeed be lowQr than the. IQ required to perform a similar. Job In 
a non-sheltered settlnq. 

• *• For v/at It's worth, however, these are the Jobs which Dolp feels 
can be adequately performed by the TMR: 

JOBS I . • '> . '19; 

<• 

Farm 

/Picking chickens '30 

- Wheeling grain : . 30 

husking <:;orn,^wash I ng veqe+ables 38 

' - Picking apples . 38 

^ . <rh Inning plants* 38 
.Cleaning automatic wafer 

^ 'fountains;' - poultry 42 

Feeding mash and grain 42 

.Setting pnl'ons , "44 

'Cutting trees , , . 44 

Tractor^ p I p\I no, .etc. 51 

i^ra^ctor syeedlnq^ 5? 

f-ia'cfvlne settlrjq filants ^' ^ 52 

^ PrunlndS fruit trees \ 52 

Hand spraying y ^-SS 

' ^ x\ ' • ' 

^ Greenhousa/* \ ' * 

CI e^l.nq fqreenhousd ^ 42' 

Ground 



r 

Using sickle .34 



\r .'Raking leaves ' . ' 31 

Hand mowl pg • 31 



'Oelp, op. cit. 
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Grounds - continued 

Repairing roads 40 

Trimming lawn edges - ^0 
Cleaning grass from-^lag stones' 40 

Laundry 

Pu 1 1 log washers 26 

De^liverlng to cottages 26 

Operating extractor 37 

Operating washer 37 

Operating mangle 37 

Sorting laundry by cottage 47 

Iron inn shirts 51 

Dietary 

Cleaning root vegetables 36' 

Drawing and cleaninq poultry 37 
Cleanl nq stoves 

Mopping floors, washing tables 44 - 

Dishing food at stove 45 

Operating potato peeler 45 

Assisting at stove, cooking 53 

Pantry 

Placing food on tables 30 

Wet mopping floors 32 

Washing dishes ^7 

Setting tables ^7 

Housekeep! ng 

Sweeping, dry scrubbing 32 
Clean tub and tol let 34 
Washing windows ^ 
Wa>^lng floors and linoleum 42 
^ Sorting and counting laundry 47 
Assisting In clothes room 54 

Carpentr^y 

Rough sanding, cleaning 53 

Ml seel laneous 

- — Press-lJia-bY.JtLa,nd^,_sevQng X 40 



The author notes that even these figures should not be considered 
rock bottom. They are merely reflective of the lowest IQ which had 
been successfully used on the job In that particular Institution, 
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The belated consideration of the TMR adult for competitive or 
sheltered employment as opposed to placement In an activities center 
has been seriously hampjsrod by a lack of tools for conducting predic- 
tive work evaluation for this population. On a great many tests the 
TMRadult, due to lack of exposure and a slower learning rate, falls 
below the range within which the tost Is designed to d I f f erent late . / 
This unavailability of appropriate evaluation, tools results in. the TMR/ 
being assigned to (usually) the lowest level /tasks within the facility, 
a decision based either on staff Impression or reported 10. 

Research Into the Job skills of im^ s (Delp, 1957) and competitive 
Job placements being recorded by vocational /rehabilitation facilities 
Indicate thar the TMR Is, In many cases, capable of sheltered or compet- 
itive employment. As the present study rey^als, however, the discwery 
of this individual pot^ntla.l Is left almosf completely to chance. 

Standardized tests of dexterity, per9eption and aptitude are, of 
little use with the TMfj?. The only study found which used a single test 
for predictive .Durposes was a study (Tobl/as and Corel Ick, 1^60) which 
used performance on the Purdue Pegboard l^o predict performance orj 
ce'rtain related sheltered workshop tasks Also noted in the study was 
the apparent positive relationship betwei^n tQ-and performance on/ the 
Purdue. This relationship was nuch higher between the Purdue arid the 
FulJ Scale and Performance V/AIS than between the Purdue and ' the Verba 1 
WAIS. I 

/ 

Studies which attempted prediction based on batteries of standard 
tests followed the same pattern of seeklog prediction for process rather 
than outcome purposes.! In an effort to a\ssess the appropriateness of 
this '*stage-to-stage" prediction, the JohVistone Project (Parn'icky, ^ 
Kahn) examined the relatlor.shlp between Initial evaluation and various 
phases of their vocational training prograVi. The phases of the pro-' 
gran at the Johnstone Center (residential) \we re: I. Eight week 
evaluation. II. One semester of ha ! f-t Ine yocat lona I tralnlinq, 
III. T^o or three semesters of full-time, normal work day, vocational 
tralriiLng on campus. IV. Daywork In the community, (no set length), and 
V. Community emp I oyment , and residence. Results of the project indicated 
that the prevocatlona I battery became increasingly less predictive 
through succeeding stages of the orogram and Had virtually no predlc- 

tlveness for the final comnunity_emj)^lpymen1\ Ihe^ratings by communltjy — 

.employers seemed particularly inconsistent wit^\ any of the predictive 
tools.*^ ! ' " '\ 

■ \ 

A study conducted at Moose Jaw, Saskatchewan, (E|i<ins. 1967) usod 
a battery of nineteen Items inciudinq standard tests, personal Inforr-a- 
^tlon, and a ratlnq scale, to study the ability of\ those Items to oredlct 
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performance on fd>jr workshoo tasks (color sort, form sort, slrr.plo five- 
piece assembly, combined cut-assemble operation). With thP exceotionvof 
the items of personal information, and the Peabody Picture Vocabulary 
Test, all of the predictor variables displayed a significant relation- 
ship t" the work samples. Other than once again indicating that there 
Is a 'general ability" factor encompassing Intelloctual and psychomotor 
skTrTs 'which is related to p^^rformance on certain tynes of job tasks, 
the study contributes littlo. The author does not follow throu^jh on his 
initial goal of prodictina job success for this oroup even though a 
subsequent study (E I ki ns / 1968) explores this with an Ci^P group. 

A somewhat similar study using some of the same instruments was 
conducted In Akron, Ohio by Edwin E. Waaner and Onnnis A. Hawver (Wagner 
and Hawver, 1965). Here the results of the predictive battery were 
compared with rankings compilea by the chief instructor of the workshop. 
Even with the addition of behavioral criteria which were to be taken 
Into consideration by the chief instructor, various dexterity tests 
^ . (O'Connor Finger and Tweezer, mrmT Placing and Turning) were found to 
be significantly predictive of sheltered v/ork^hop norfornanco. Unlike 
the published results of the Elkins study, however, tho relationship 
was positive. To Wagner and .Hawver, however, the nreatesi significance 
was found In a test not customarily administered in a work evaluation 
unit: "The correlations between the Bonder Visual- 'otor Hestalt rank- 
ings and the criterion rankings Is exceotior.al ly high and accounts for 
approximately 1^% of the total variance. thf> basis of the OG alone, 
It would be possible to predict rankings cf workshoo performance for 
these subjects with a high denree of accuracy. ^ Although the test 
population was oulte limited in size and was observed only on benchwork 
and woodworking, the study once again appears tn indicate the presence 
of a general ability factor which the authors call an *'inactness" 
factor. No effort is mado to qener^liz'=^ the pr^^dlctive- results of the 
^ tests used. The authors do not claim that these instruments will pre- 

dict success In community omoloyment. 

The predictive ability of work sampler in neneral remains In 
doubt prlnarily because of the lack of standardization of samples and 
the basic question of Ju6t how similar the r^snonses to a sample are to 
those which will be elicited by actual work, '^ost of the traditional 
work-sample batteries such as T0WE9 renjire verbal cop.orehcns Ion In 
excess of that nossos«;oc' bv a TMR. A dossIMp exception Is the Wide 
Range Employment Sample Te«?t by Jastak and Klnq.. The ten ba'<;ic work 
tasks (similar to jobs found In both sheltered and competitive employ- 
ment) require no reading and a minimal level of verbal comorohcns Ion. 
They have been normed on both handlcaoocd and non-handicapped workers. 
^rTvH'l populations of T"R stud6.'nts were Involved In some of the normlng. 
However, the statistical basis for the norm^, an^ t^^ analysis o.f data 
aopear ooon to question, 'leverthe I ess , the batterv appears to have 
potential us^ with P^R ^rouos. 



1 Wagner and Hawver, oo, cit. o.'"^'^^. 
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The rating scale Is the evaluative tool used most frequently In 
a situational evaluation where the client's work and worklna conditions 
are constructed to approximate "roal"' work. Rating scales, despite 
their Inherent weaknesses appe^xr to be, presently, the best predictive 
tool for use with the TMR. This Inference Is based on the "track 
record'' of rating scales used with other populations rather than on 
their use with TMR^s. 

Pioneer research in the use of the rating scale for predictive 
assessment was carried on by the Chicago Jewish Vocational Service 
(Gellman, Stern and Soloff, 1963). Chicago JVS initially designed three 
scales; Counseling, Psychology and Workshop, Although predictiveness 
was ^'moderate at best" (to quote the authors) three itens, on the work- 
shop scale were found to be significant for both placement and mainten- 
ance .of employment: maintenance of Quality, acceptance of Work demands, 
and clerical ability. Each scale contained other Items significant for 
either placement or employment maintenance. 

Subjectivity of the Chicago JVS scale was Increased by the use of 
many ambiguous terms, such as "very ste.-^ny", or "Inadequate* , In the 
muftlple-cboIcQ responses to each scale item. Research on the scale 
continues to become available. An example Is the 1970 revision 
(Bolton, 1970) utillzInQ J. ^3. Taylor's method of scale construct ion • 

Another rating scale upon which o significant amount of research 
has been done Is the Work HablTS Scale taken from the Vocational 
Capacity Scale of the ''acDonold Training Center, Tanpa, Florida (Fergu- 
son-Plnkard, 1963). Since the WfIS is part of a \3rqor battery, the 
authors caution againr.t using It by itself for predictive purposes. 
It has proven, however, to be the best single pcodlctor within the 
VCS. The scale uses thirteen Items to rate Learning and ronorrhens ion. 
Performance, Attitude Toward V/ork, and Interpersonal ^oMtions. Four 
descriptive state^^nts are listed for each item but once ag^ln often In 
ambiguous terms. 

Two ratim scal'^^s which are availablo through customary 'sources 
are the * San Francisco Vocational Competency Sc.^le' (Lovlne and Elzey, 
19G8) and the 'T.M.P. Performance Profile" ("^I'lola, K^mlnsky and 
Sternfeld, l^'^^B). The San Francisco Scalo was developed aro'jnd 
responses to quost lonncl ros received from sixty-eight workshops con- 
taining mentally retarded oopulatirns. Th^^se responses were coupled 
with Interviews and observations determine those behaviors nocessary 
to the development of vocational competence* Duo to tht^ lack of 
validity data available on tho tost, I t,J_s.^,5ii^3osted that It's u3o be 
limited to test-retest situations. 

The T.M.R. Perfornance Profile attempts to rate all areas of the 
functioning of the trainable mentally retarded and Is developed 
basically for classroon use. Many of the items and areas contained In 
the test would be usoful If. vocational '^valua+lon. Mo effort h:^'*^ heen 
made to use the test for predlctivo nurnoses. It Is rocomf-^en ir ^v the 
authors only for periodic reassessment of Individual progroo^. 
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The August, 1972, issue o*f the Training School 3ulletln contains an 
experimental edition of a rating scale by Lloyd K. Daniels which was 
developed fron a ^.aso of four hundri^j sraronert-, taken from other rating 
scales. The stator^'^nrs vv-ro scroontd by Trained personn*=*) in the field 
of rehabilitation. Toe- itenis eloctod wore actually never tested for 
validity since thf) scalo was designeJ nore ly to provide a systematic 
manner of roportinn work adjustment data for use In a larger research 
project. 

There have beer, at least two attonpts to produce ccnprehens I ve 
batteries of tests for the predictive vocational assessment of the TMR. 
The first of those, the Vocational Caoaclty Scal^ (riacDonald Training 
Contor) was developed on a handicapped population wltfWn the educable 
rather than trainable ranqo. It uao subsoaucntly validated, however, 
(Cayan, 1963) on an Institutional, TMR, oopulatlon. « Items in the 
present version of the VCS are: ^ Work Habits Scale, VIneland Social 
Maturity Scale, Manual Skills (fron the Pennsylvania Bl-Manual Work- i 
sample). Arithmetic (possibly to be dropped in further revisions), and 
Direction Following (Wells Concrete niroction Test). , Th Is .battery was 
used to predict the eventual voc-itional lovoTwhlch would" be attained 
by the clients tested. Althouqh the 'lac'^onaM project has been crit- 
icized for weaknesses In reaearch desinn, the Onyan follow-up recorded 
even greater validity while avoid I nq the pitfalls In research. 

The other battery which includos research with a TMR population Is 

the McCarron-Dlal Work Eval .afion System still in the process of release 

through Indiai.a State University (T'^rro Mauto, Indiana). This battery 

attempts to evaluate five predictive factors: V.orbnl -coqnltivo. Sensory, 

Motor', Emotional, and - 1 ntegrat I on and Ooplnq. This evaluation Is ac- 
complished through a combination of standard' tests , specially designed 
tasks, and rating -scales. 

Although th'^ Initial rater la I on this battery Is encouraging, 
sufficient lnfor->atlon Is not yet available to allow a true evaluation 
of the McCarron-Dial System. \ 

Sl.-^cp a strong correlation exists between Job satlsfacl^bt^^nd 
success, and since there Is evidence that TMR's arc capable of d^men^ 
strating v.J Id vocational proforencos (^ohen and "usalem, 1964), the 
"Interest tests suitai^lo for use with o TVR_ population we-^e explored. 

Thpre are presently thrc'^ Interest t^sts which arp completely non- 
verbal: The Vocational Interest aAd Sophistication Assessment (VISA), 
The Wide Pane Interest and Oplnl'^n Test (wn>|OT), and the California 
Pictur.? Mtorest Ir.ventcry (PI I). Th^r^ has also been an effort made 
to adapt *he Oelst Picture Interest Inventory (^'^Pl I ) for ^ non-reading 
popu I at I on. 

Tho Vocational Interest and Sophistication Assessment (Parnlcky 
and Kahn) Is tho only ono of the tests desMned specifically for use 
/^th a r--^tardcd pocjlatlop. As wl+h t^^ ras^ of the other twc non- 
verbal t^-'Sts. .^11 iol'-, aro presented nictorially. Unlike the other 
tests, the VISA does not require the testee to chose between pictures 
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but to rank each picture as to whether he would like to do It "a lot", 
''a little** or '*not at alT'. The pictures are simplified line drawings 
with extraneous detail excluded and the Jobs pictured arc those con- 
sidered nost readily available to the PIR, The VISA also contains a 
''sophistication" section In which the testee Is asked questions designed 
to determine the amount of knowledge he possesses concerning the various 
JoiL^reas pictured. The premise Is that for an Individual's Interests 
to have high validity, the Interests should reflect knowledge of the 
Job area. 

The Wide Range Interest and Opinion test and the California 
Picture Interest Inventory both present pictures In groups of three 
requiring the subject to chose which pictured activity he prefers. Of 
the two ^ests the WRIOT pictures a wider variety of activities', shows 
both sexes engaged In the work activities and appears to Illustrate 
more contenporary work fields, 3oth tests contain a number of activities 
which would be unrealistic for the VP. The WRIOT results In the 
greater amount of scoring Information and Includes an "Agr^^ement" 
(val ldlty)scale, - ^ 

Ourg and Barrett (1965) developed an. administration, of the Geist 
Picture Interest Inventory for males which required no reading on the 
part of the subject. In this oral administration the testor both 'read 
the sentences printed In the test booklet and described eacK of the 
pictures to assure that the activity was understood by the person taking 
the test. 

In the course of the present research project several studies deal- 
ing with Tt^R populations cane to light which did not fit within the 
stated boundrles of the research. These were Included because of the 
Insights which they contained and their potential bearing upon predic- 
tive vocational assessment of the P^R, 

A study was conducted in 1961 (Meadow and Greenspan) at the Jewish 
Vocational Service and the Community Workshop in Detroit +o determine 
the effect of work exocsure (sheltered) on a basically TMR population. 
The test battery was administered before and after a three month workshop 
exposure. The authors concluded that although there was no significant 
change In scores on the standard tests, there was an alteration In work 
attitude as a result of the exposure. The work Itself appeared to be 
motivating and fhhe resulting paychecks were a source of pride,._ The size 
-of the paycheck did not see'n as Important to the clients as the fact 
tbey were working for pay. Those results Darallel those In a similar 
study done with an E*^^ population by Shulman (1967), 

Effects of repeated work sessions and various motivators on a VAR 
population were explored by Tcblas and Gorellck at the Occupation Oay 
Center In New York, 

Except for the lowest 10 group (?0-?9)» a layoff of several weeks 
did not adversely affect production. In fact, within the 30-50 10 
ranae production reached Its peak at the session immediately fol lowing 
the layoff. After an announcement was made concerning payment for the 
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work, there was a slight Increase In productivity but only temporarily* 
Fatigue and boredom (caused by an extended session) resulted In a 
significant decrease only with the 20-29 10 group. 

There were six subjects who failed to learn the task and remained 
non-productive throughout the sessions. These all had lO's between 15 
and 20 causing the autnors to speculate that an IQ of 20 might be a 
general cutoff for productive activity. The fifteen subjects diagnosed 
as mongoloid had hourly production floures lower than non-mongo folds of 
sinl lar 10 and age. 

Another study by Tobias and Gorf^llck (1960) concentrated on the 
tendency of sono trainees to arr^ncc and organize their comDleted work 
far beyond tho requirements of the job. The study found that this was 
not a universal tendency amonn retarded, but It did occur more 
frequently anon^i lower P groups and always had a negative effect upon 
production speed. This could be counteracted bv arranging the work In 
such a v/ay that ordering was Impossible. 1 1 Is a I so a tra 1 1 which 
could be observed In in evaluation unit and seen "as detrimental to 
high productivity. 




CONCLUSIONS 



The needs are apparent and Intnedlate. Trainable mentally retarded 
adults are In residential Institutions when they could be In their own 
corrwunltles. Some have been delegated to '''activities" programs when 
they could be experiencing the accomplishment of productive labor. 
Others are restricted to sheltered facilities when they are capable of 
competitive employment. 

' An extensive review of the literature related to ^^he ^pred Ictive 
vocational assessment for the im adult indicates that consistently 
reliable and valid Instruments do not presently exist;. ^ 

It therefore becomes necessary, especially In -the light of Ohlo^s 
Increasing, appropriate concern for the "humani zatlon" of all of Its 
handicapped, for predictive tools to be developed, validated and made 
available to facilities throughout the State* 

At this point, those existing tools which appear most promising 
are the comprehensive test batteries developed by the MacDonald Training 
Center and the McCarron-DIa I System. The rationale for their selection 
Is that evaluation needs to be of the whole person and not merely one 
facet such as productivity or work behavior. It should be noted, 
however, that neither of these batteries Includes an assessment of 
Interest. It Is noteworthy that the Vocational Interest and Soph 1st I- 
catlon^Assessment Is part of a test battery developed at the Johnstone 
Training Center In New Jersey but not researched with a TMR population. 
This entire battery might realistically be examined for potential use 
with the TMR population. 

In working with the Vocational Capacity Scale (MacDonald), 
various test Instruments could be administered In parallel with or In 
place of those currently Included In the scale to Improve predictive- 
ness. The MacDona I d> Center Itself Is following thks procedure. The 
McCarron-DIal System should be used In Its entirety to enable uti I Iza- 

tlon of normative data currently being released. Further; research and 

validation studies j?/IJtLJihlS-ba±ter-V^-^ou-W^^^ 

appropriate and practical concern with all the Interest tests surveyed 
would be an assessment of the TMR's perceptlonr of the actual pictures 
presented. Perhaps the conceptions of the artist are not being conveyed 
and the client taking the test Is either responding to secondary fea- 
tures In the picture, or misinterpreting what the worker Is doing. 
Burg and Barrett (jresuppose this In their treatment of the Gelst by 
verbally Identlfyfng the pictures. In the VISA the subject's under-^^ 
standing of the pictures *3 measured by means of the "Sophistication" 
portion. Apparently no effort has been made to evaluate the WRIOT or 
the CPU In this regard. 
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Further studies would also be appropriate regarding the real 
significance of the vocntlonnl choices of the "RIR. Do those remain 
conslstant? ^.re thoy ro3 I i st Ic? ' Arr the Interests strong enough to 
provide qoals worth workinq tow.ird? 

At least in theory, tho single best pr'^dlctive tool for vocational 
potential V(puld apr^oar to bo son6 forn of a rgtlnq sc=^le. Although 
none of the existing Instrunonts are sufficiently prodlctlvo to be used 
for Individual prediction, thoy do provide a tool for fr'^quent ro-eva lua- 
tlon of nronress by conparinc] the client wl th ,h i'^'^ol f . It would appear 
that the predictability of these scales could he Inoroved thmuqh the 
use of more precl^je and objective ternlnologv. Her« as In no other area 
of evaluation the subject I veness and possible projudlcos of the rater- 
can Influence the rr^sults when ho Is asked to provide nsses'^mont In 
terms of 'satisfactory', occas ion^J ly ' , etc. 

The TMR Porf or'n'jnc^ ^Voflle Is already nainlnq sonn us'^ within the 
TMR schools In Ohio. For that reason. If Its significance for voca- 
tional evaluation c^n^ bo deter^ninod, it nay hpcpnr^ an esneclally 
valuable tool becau*"^^ it will allow contlnuel mnssessnont over an 
extended period of tlnr , 

Other rat I no scales which merit further rrsenrch with TMR ooou I ac- 
tions would be the San Francisco Vocational Conpetency Scale because of 
Its wide use which '•should result In the frequont issuance of new data; 
and the Vocational Adiuritnent "latino F^calo (Oaniels) which Is an 
attenpt to utilize tho best strjtonents of other rati no scales. 

Insofar as Individual, standardized tests of antltudo, pprceotion 
and dexterity aro concerned, they serve little function except perhaps , 
to provide suqqestlons for a starting p\<\cn within tho next stage of 
tho rehabilitation orocnss. Showinq some pror^Ise for this puroose Is 
the Wide Ranqe Enoloy^ent Sample Test. This tost apoears to most 
closely aporoxlnato the types of productive activity found In the 
majority of sheltered facilities. Much nore extended research with this 
test will bo n^c^S'^.'^rv, hov/ovor, befor^^ It can be niven r-erlous consid- 
eration. 

Some areas, apoar'^ntlv. ro^nin completely unexplored. Oelp In his 
study listed many jobs In an instliutional settinq which could apparently 
be performed by Trainable -Retardates but what are th^* realistic Job 
oPDortunI t Igs In tho conr^iuni ty? Th'^ro are a number of "screeninq" tests 
for jobs reoulrlnq mechanical aptitude, dexterity, etc., but what about 
service areas - food service, lanltorlal, patient aide? What about a 
method of assessing the work personality o* th.-> T'^R throuqh direct 
questlon-rosoonse rather than detached observaMon? 

A^ the present timp there are no "proven" predictors of employ- 
abillty - either sheltered or open community, for the trainable mentally 
retarded. This Is the situation In spite of the fact that TMR»s are 
successfully fin'jlnn not only sheltered but competitive e^ip loyment^j I n 
the comr3unity. 



How many more with siml lar -capabi 1 1 ties are still burled In 
Institutions,, activities centers, and ternfjnal sheltered workshops 
wIM not be known until effective predIr>tWe methods of evaluation 
are aval lable. 
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APPENDIX 

IDENTIFICATION OF TEST INSTRUMENTS 
MENTIONED IN STUDIES 

BENDER-GESTALT (Also applies to BENDER VISUAL MOTOR GESTALT): 
A brief test requl ring the copying (of designs. Departures from the 
originals are Interpreted In terms jof Gestalt laws of perception and 
organization. Test results are thqught to be susceptible to altera- 
tion through fatigue and administration procedures.' A 1960 survey 
(Schulberg and To I or) 2 Ind Icated" that 80? of psychologists sampled 
found the Bender useful for differential diagnosis Involving organlc- 
Ity. Predictive validity has been Indicated as low. Projective use 
of the Instrument 'should be with caution. 3 Available from Psychological 
Corporation . 

BENNETT HAND TOOL DEXTERITY: The client Is presented with a boarc 
on which combinations of nuts, bolts; and washers have been assembled. 
The combinations are to be disassembled and reassembled on the other 
side of the Board using three sizes of wrenches and a screwdriver. Some 
_ reviewers recommend caution In the use of some of the norms presented 
. because they are based on smal I , poorly defined groups.^ Aval lable from 

Psychological Corporation. 

CRAWFORD SMALL PART DEXTERITY TEST: Designed to "measure fine eye- 
hand coordination." In part one, the testee uses tweezers to place pegs 
In a board and collars on the pegs. In part two, he utilizes a screw- 
♦ driver to screw thirty screws !p holes. . Norming samples are of adequate 
size and several validation studies' have been made. 5 Available from 
Psychological Corporation. ^ 

GOODENOUGH-HARRIS DRAWING TEST: This Is an extension of the Goo'd- 
enough Intelligence Test for ages 3-15. The present version asks the 
testee to draw pictures of a man, a woman, and himself. Each Is scored 
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IPhIMp M. KItay, "Bender-Gestalt Test", Seventh Me ntal Measure- 
ments Yearbook , ed. Oscar Krisen Buros|tHIghIand Park, New Jersey-,- - 
Gryphon Press, 1972), Vol. I, p. 394. 



2lbld. 



3lbld. p. 395. 

^Karl P. Botterbuso D. cit. 
5lbld. pp." 53f. 
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on numerous points as a determination of Intelligence. In addition, the 
picture, of self was Included as a posslb.Le^coJectJv.eJ:est of personality 
to be compared with the other drawings. Results on this experimental 
use are not promising at this point, however^"* Unsuccessful attempts 
have been made to project this test Into higher age groups • Thus, 
although ^It has been mentioned In at least one study (Wagner and Hawver) 
It shouTdTnot be administered to adult groups. • Avaflable from Western 
Psychologlpal Services or Harcourt Brace Jovanovlch, Inc.^ 

KOHS BLXK DESIGN: Developed as a performance test of Intelligence. 
The testee is presented with a series of one Inch cubes with different 
colors on^ea^ch side. He Is then required io duplicate given designs 
with the blocks... -Presenf^val labi I Ity unkiiown. 

LI'NCOLN-OSERETSKY MOTOR DEVELOPMENT SCALE: ^'Designed to test the 
motor ability W children between the ages of six and, fourteen years. 
l-t~Is an Individually administered scale consisting of 36 Items Invol- 
ving- a-^wlde variety of motor skills, such as finger dexterity, eye- 
hand coordination and gross activity of the hands, arms, legs and trunk. 
Unilateral and ^^I lateral motor tasks are Involved In the scale". 2 
Available from f\)e Stoelting Company. 

MINNESOTA RA\TE OF MANIPULATION TEST: (MRMT) An Instrument often 
used In selectlng\appl Icants- for Jobs requiring gross arm-hand 

" manipulatory movenients. Consists of two rectangular boards with sixty 
holes each and sixty cylindrical blocks to fit Into the»holes. Most 
commonly used sub-tests are the "Turning" and "Placing" (the only sub- 
tests In early versions). Now Included are "Displacing", "One-hand 
Turning and Placing'' and "Two-hand Turning and Placing".^ The major 
norms are unchanged .since 1946. Schoenfeldt states that In light of 
Inadequate norm_and yal Idl ty -Informa'HonT'useri' would do well to develop 

— job=--siJ©^CitTc^orms and validity Information. ^ Available from American 
Guidance Service. \ 

' O^CONNOR FINGER DEXTERITY TEST: Small pins are Inserted by hand 
In holes In a board. Three pins are Inserted In each hole. Reliability 
1 seems satisfactory. Care should be taken not to generiallze validity for 
Jobs which require- other types of manipulative ability.^ Available from 
-Western Psychological Services. 



Unne AnastasI, "Goodenough-Harr I s Drawing Test", S eventh Mental 
Measurements Yearbook , ed. Buros, op. cit. Vol. I, p. 670. , 

2stO(^ltIng Company, Psychological Tests and Instruments, 1972 
Catalog, ^Stoeltlnq Company, Chicago) p. 7. 

F. Schoenfeldt, 'Minnesota Rate of Manipulation", Seventh 
Mental N^'asurements Yearbook , ed. Buros, op. cIt. Vol. \\, p. 1483. 

^Arfne AnastasI, Psyc^-^^Ioqlca I Testing, (The Macmlllan Company, New 
York, 1964), p. 381. 
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O'CONNOR TWEEZER DEXTERITY TEST: SPngle small pins arcjnserted 
iii holes using tweezors. As with Finger Dexterity Tost, AnastasI notes 
that reliability seems satisfactory but there Is danger In general I ra- 
tion of results J Available from Western Psychological Services. 

PENNSyLVANiA BI7MANUAL WORKSAMPLE: the examinee turns/a nut onto 
a bolt aod^places the assembly Irtfto a bole In a board. Designed to 
assess finger dexterity, gross arm * movement , eye-hand coord I nation and 
bl-manual coordination. Norms estab'Mshed for age's IG through 39<t2 
Available from American Guidance Service^. 

PORTEUS MAZE TEST: The Porteus Ma Z£' Test Is listed as a perform- 
ance test of general I ntel l.lgence. Standard testing procedure Is to 
have the subject trace with a pencil the shortest path from the entrance 
to the exit of a maze without llftlhq his Dpncll from the paper. As 
soon as an ''error*' Is made by cominn in contact with a line or proceed- 
ing i up a blind alley, the maze Is removed and a second, tr la I Is given 
on an Identlcal'maze. If another mistake Is made, a "failure?;' Is 
recorded on that level ."5 The test Is listed as useful from age three 
through adult but adult norms are 'not<glvefTV Scores are to be converted 
to IQ estimates with an addltlonaj "0" Score based on test behaviors 
which Is correlated with various Indices of social adjustment. The test 
can be administered without verbal Instructions. Docter^ nptos that the 
test seems to detect changes in performance not shown In other tests - 
such as Wechsler-Bel Ivue. It therefore seems that maze-solving call^ 
for probleni solving competencies not required by. many other tests. ^ 
Present standardization ana validation of the test Is poor (but .enter- 
taining says Horn5), Horn states th^t the user should satisfy himself 
that (a) the norms apply In the population of which he is concerned, 
(b) whether or riot the test reliability Is sufficient for his purposes 
and (c) what Jong term practical predictions the test c*an support, o . 
Some test figures for retar^jed children are Included In the revised * 
manual. Available from Psychological Corporation. 



'ibid. 

2Amer I can ^Guidance Service^ 1^73 Catalog: Test^ and Educational 
Materials , (American Guidance Service,. Inc. , Publ IsherX'^.Bul Iding, 
Circle Pines, Minnesota) p. 25. 

3Anastasl, Psychological Testing , op. cit. p. 248. 

4Rlchard F. Docter, ''The Porteus Maze Test", Seventh Mental 
Measurements Yearbook , ed. Buros, op.* cIt. Vol. I, p. 752, 

5john U, Horn, ''The Porteus Maze Test", Seven1;h Mental Measure- 
ments Year book, ed. Buros, op. cIt. Vol. I, p* 753. ? 

6|bld. p. 756. 
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PURDUE ftEGDOARD; A wlcioly ur^cd moas»iiro of hnnd/f I nfier/^rm 
dexterity andl^f Ingerl ip'' coordination. Pons arr- Inserted In holes In 
a woodein board, Each hand Is tor, tod r,opfirate I y then the hands together. 
Finally a four-part -assembly Is-asfilgned using both hands, Val Idlty 'and. 
reliability coefficients are low and It Is suqqested that the test not 
be used ^except as part of a tost hattery.^ Available from Science 
Research Associates. ^ ^ ^ . ■ • ^ ' 

RAVEN COLORED PROGRESSIVE MATRICES: ^ A nnnvverbal test ^designed +o 
aid' In assessing mental ability by roqulrlnq the examinee to'^eiyo.. 
problems presented Mn abstract'f tgures and deslqns. Jt is printed In 
several colors and In th55 form is desiuned for usewlthVoung children ' 
and with older persons v/ho are mentally subnormal or Irnpolre^.? 
Avalla'ble from Psychological Corporation. ' ^ 

ft 

STANFORD-^ I NET: A tost of ye^iorejl intelllgbnce frequently used by 
school systems. The test Involves o series of tas^s for age levels from, 
two years to adult. The' tests for each-aqoMevel are similar In diffi- 
culty and alternritos aro provided. Tests run the gamut -from simole 
manipulation to abstract r<^asonJng.5 Frcldco^ soes the Stanford'-BI net 
as a largely outdated Instrumort reflecting an^ nnt louatod uniiary con- 
cept of I ntel I Igonco. He suggosts thot Its only practical usefulness 
Is In testing betwccrrthe aqos of thirty months (the top colling for the 
Bay ley Scales of I nfrint^Developmont ) and forty-eight months (the lowest 
age of the V/ecf^sler ^re-Schoon." !'o spec I f lea I ly cautl! against Its 
use with TMP adults'. Avallabl'o from [ioughton Miff J In Company . 

-^UCLANI) SOCIAL ''ATURITY SCAIE:^ A dovelopmentai.' schedule ccnccrnec! 
w«ith indlviduarr* ability to look^afrer pfact^cal needs. The t. st Is 
composed of one hunJrod and '^oventecn iters arranqed at year levels. 
Answers ?re obtaln<iC' Ly Intcjrvitiw. Thr Vineland haa beon used 
clinically in ttu; dlaqnosls of f-*r^n+al Retardation. -^There is some 
complaint fhat tho norms are 1 padeqtiate^* and there are difficulties 
In the use o^ this tool ^wlih the Institutionalized because they fre- 
quently have l^cl-od th(; opportunity to perform oven the task9 of which 
they are capabkr. Available from Psycholoqlca I Corporation or American 
Guidance Service. 



'3ottorbu<;ch , od. clt. pd. 57f. ' t 

' *^The ^sycholcglccil Corporation, T est Ca tal on 1^ ^4) .(The ??sycho- 
I on lea I Corporation /now Yorl^), p. ^ ' 

. ^Anas^asl., '^'^vcho I on I ca I Te^>'^ 1 ng ,^ op. clt. p. 19f . 

'^Dav i d f^rv I d^'-'S Stanf oro-i:; 1 nci " , Sev enth Mental Moasuremont s 
Yea£bo;ok, Muros, op. cli. Vol. I. pp. Tl'Z-ll's, \^ ^ . 

^Anas-tasi . /f'sycho^oqical Testing, oo. clt/ pp. 296-297. 
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WECHSLER ADULT INTELLICQICE SCALE: (WAIS) This Is a descendent 
of the V/echsler 3el levue Intelligence ^calo and Is composed of eleven 
sub-tests. The verbal score, reflecting to some degree, academic ex- 
posure, Is'composed of the Information, comprehenslor , arithmetic, 
similarities, digit span, and vocabulary tests. The performance scale,' 
Is compiled of digit symbol, picture completion, block design, picture 
arrangement and object assembly. ^ - ^ ^ 

The WAIS Is the most widloly used Instrument for assessing adult 
Intelligence although there Is much to Indicate that cultural minorities 
come off at' a disadvantage in certain subtest areas.' It Is not known 
If individual sub-test scores have been examined for predictive features 
with B1R populations but discussions of the test, stress that sub-tests 
" are not-synonymous with factors or'spoclal aptitudes. ^ Available from 
Psychological Corporation. 

WECHSLER INTELLIGCICE SCAlE FOP CHILDREN; (WISC) This test Is 
quite similar to the WAIS (see above) but Is designed for children from 
five to fifteen CThe 1974 revision, WISC-R, Is listed for ages 6-0 to 
16-11). Hn general the differences between the two tests Involve 
^ simplification of scale items similar to those found on the WAIS. 
Freldes echos most critics by co^ncludlng: 'The WISC is currently t e 
best available compendium^ of individually adml n I stered, subject com- 
parison techniques purporting to measure Intelligence."^ Due to the 
age range the test is.,^i course, unsuitable for administration to BIR 
adults..^ Aval lable from Psychological Corporation. 

WELLS CONCRETE DiRECTIOfiS TEST: This test Is reproduced In full 
In the MacDonald study (Ferguson-Pi nkard project)^ but Is no longer In 
print. The test was orl Inally used, for the selection and classifica- 
tion of Army personnel--" The test Involves a variety of common objects 
'such as hammer, paintbrush, screw driver about which the testee Is 
given concrete directions of varying complexity. An example: "Place 
the pliers to the left of the hammer/* A more complex example Is: 
"If the hammer Is to the lef'i of the screw driver then put the lock to 
the right of the paint brush and the pliers at the near end of the screw 
driver. If not, then place the key to the near end of the hammer 

Ulvin G. Bursteln, ''The Wechsler Aduit Intelligence Scale'', The 
Seventh Mental Measurements Yearbook , Buros, op. cit. Vol. I, p. 787, 

2Leonard A. Miller and C. Esco Oberma^nn;-" I ntel I igenco Tests'', 
Studles'in Continuing Education for Rehabilitation Counselors, 
(Materials Development Center, University of Wisconsin, Stout, Menomonle, 
Wisconsin) p. 7. 

3r.T. Osborne, "Wechsler Intelligence Scale for Children'*, 
Seventh Mental Measurements Yearbook , Buros, op. cIt. Vol. I, p. 803. 

I AMacDonald Training Center Foundation, 'The Vocational Capacity 
Scale", op. cIt. pp. 24-26. 
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yiDE RANGC ACHIEVEflENT TEST: (WP>AT) An Ind! 
test of **2ch ieverjont" \^^\ road Inn (oral nronunclat Ion 
with conprohons!on) , artthnetic, and '^r^olllnn. f^erv/In^, soos 
Impractical for c!ccuratc\ assessment of acadonlc functlonlnq, 
handy for assessinq qenoral functlonlnq, |pvpI^> wfthln the threb areas 
for pract lea I purposes such as estobllshinq a function! no base \f or 
determination of appropriate further testing, Thorndll<e2 seriously 
questions the validity of the test and '♦'he mpthods used to arrlVe at 
much! of the statistical datn. He dofinltoly oncou^agc^ Its use for 
nothing norc than n "nulck estimate of ^^--^ch Dorson's qbnera I Icvej of 
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^Jack C. ^*ewwin, '*Wlde Ranqe Achievement Test", Se venth Menta I 
Measure monts Yearho o<, Buros, op,^ cit. Vol, i, pp, 66-67. 

-^►^obert L. Thorndlke, "Wide Ranqc AchJovement Test"', Sevf^nth 
M ental Modsuronon t? "^oarbook, ^^uro*^, oo. cit. Vol. I, p, ^^8 
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